Apr 07 06:00:44 devstack cinder-volume[72468]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72468) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 07 06:00:44 devstack cinder-volume[72468]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72468) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 07 06:00:44 devstack cinder-volume[72468]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72468) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 07 06:00:45 devstack cinder-volume[72468]: INFO dbcounter [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Registered counter for database cinder Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_db.sqlalchemy.engines [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72468) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG dbcounter [-] [72468] Writer thread running {{(pid=72468) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 07 06:00:45 devstack cinder-volume[72468]: INFO cinder.rpc [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 07 06:00:45 devstack cinder-volume[72468]: INFO cinder.rpc [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_db.sqlalchemy.engines [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72468) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:00:45 devstack cinder-volume[72468]: INFO cinder.volume.manager [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Determined volume DB was empty at startup. Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG cinder.volume.manager [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72468) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 07 06:00:45 devstack cinder-volume[72468]: INFO cinder.volume.manager [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 07 06:00:45 devstack cinder-volume[72468]: WARNING stevedore.named [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 07 06:00:45 devstack cinder-volume[72468]: WARNING castellan.key_manager [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 07 06:00:45 devstack cinder-volume[72468]: WARNING cinder.keymgr.conf_key_mgr [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG cinder.volume.drivers.lvm [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72468) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_concurrency.processutils [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72468) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_concurrency.processutils [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] CMD "cinder-rtstool verify" returned: 0 in 0.256s {{(pid=72468) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_db.sqlalchemy.engines [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72468) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:00:45 devstack cinder-volume[72468]: INFO cinder.rpc [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 07 06:00:45 devstack cinder-volume[72468]: INFO cinder.rpc [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 07 06:00:45 devstack cinder-volume[72468]: WARNING stevedore.named [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 07 06:00:45 devstack cinder-volume[72468]: WARNING castellan.key_manager [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 07 06:00:45 devstack cinder-volume[72468]: INFO cinder.volume.manager [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_db.sqlalchemy.engines [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72468) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:00:45 devstack cinder-volume[72468]: INFO oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Starting 1 workers Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Started child 72575 {{(pid=72468) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Full set of CONF: {{(pid=72468) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] ******************************************************************************** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Configuration options gathered from: {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] ================================================================================ {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] allow_availability_zone_fallback = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] allow_compression_on_image_upload = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] allowed_direct_url_schemes = [] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] api_rate_limit = True {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] auth_strategy = keystone {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] az_cache_duration = 3600 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_availability_zone = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_host = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72575]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_name = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_stats_polling_interval = 60 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backup_api_class = cinder.backup.api.API {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backup_name_template = backup-%s {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backup_use_same_host = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backup_use_temp_snapshot = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] chap_password = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] chap_username = {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cinder_internal_tenant_project_id = 5093758e43904687b9852073a27101f9 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cinder_internal_tenant_user_id = 9dcda862e7db415e9d50a199a862b6dd {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cloned_volume_same_az = True {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cluster = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] compression_format = gzip {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] compute_api_class = cinder.compute.nova.API {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] config_dir = [] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] config_source = [] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] control_exchange = openstack {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] debug = True {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] default_availability_zone = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] default_group_type = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] default_volume_type = lvmdriver-1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] disk_geometry = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] driver_client_cert = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] driver_client_cert_key = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] driver_data_namespace = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] driver_ssl_cert_path = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] driver_ssl_cert_verify = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] driver_use_ssl = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] enable_force_upload = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] enable_new_services = True {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] enable_unsupported_driver = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] enabled_backends = ['lvmdriver-1'] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] enforce_multipath_for_image_xfer = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] filter_function = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance_api_insecure = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance_api_servers = ['http://192.168.122.117/image'] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance_api_ssl_compression = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance_ca_certificates_file = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance_catalog_info = image:glance:publicURL {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance_certfile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance_keyfile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance_num_retries = 3 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance_request_timeout = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] goodness_function = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] graceful_shutdown_timeout = 5 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] group_api_class = cinder.group.api.API {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] host = devstack {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] image_compress_on_upload = True {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] image_conversion_address_space_limit = 1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] image_conversion_cpu_limit = 60 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] image_conversion_disable = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] image_upload_use_cinder_backend = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] image_upload_use_internal_tenant = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] image_volume_cache_enabled = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] image_volume_cache_max_count = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] image_volume_cache_max_size_gb = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] init_host_max_objects_retrieval = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] instance_format = [instance: %(uuid)s] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] iscsi_target_flags = {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] iscsi_write_cache = on {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] iser_helper = tgtadm {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] iser_ip_address = 192.168.122.117 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] iser_port = 3260 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] log_color = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] log_config_append = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] log_dir = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] log_file = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] log_options = True {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] log_rotate_interval = 1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] log_rotate_interval_type = days {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] log_rotation_type = none {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] max_age = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] max_logfile_count = 30 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] max_logfile_size_mb = 200 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] max_over_subscription_ratio = 20.0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] message_reap_interval = 86400 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] message_ttl = 2592000 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] migration_create_volume_timeout_secs = 300 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] monkey_patch = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] monkey_patch_modules = [] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] my_ip = 192.168.122.117 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] no_snapshot_gb_quota = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] num_iser_scan_tries = 3 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] num_shell_tries = 3 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] num_volume_device_scan_tries = 3 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] nvmeof_conn_info_version = 1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] nvmet_ns_id = 10 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] nvmet_port_id = 1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] osapi_max_limit = 1000 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] osapi_volume_ext_list = [] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] osapi_volume_listen = 0.0.0.0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] osapi_volume_listen_port = 8776 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] osapi_volume_use_ssl = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] osapi_volume_workers = 2 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] per_volume_size_limit = -1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] periodic_fuzzy_delay = 60 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] periodic_interval = 60 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] project_id_regex = [0-9a-f\-]+ {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] public_endpoint = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] publish_errors = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] quota_backup_gigabytes = 1000 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] quota_backups = 10 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] quota_gigabytes = 1000 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] quota_groups = 10 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] quota_snapshots = 10 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] quota_volumes = 10 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] rate_limit_burst = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] rate_limit_except_level = CRITICAL {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] rate_limit_interval = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] reinit_driver_count = 3 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] replication_device = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] report_discard_supported = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] report_interval = 120 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] reservation_clean_interval = 86400 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] reservation_expire = 86400 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] reserved_image_namespaces = [] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] reserved_percentage = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] rpc_response_timeout = 120 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] run_external_periodic_tasks = True {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] scst_target_driver = iscsi {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] scst_target_iqn_name = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] service_down_time = 720 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] shell_completion = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] snapshot_name_template = snapshot-%s {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] snapshot_same_host = True {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] split_loggers = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] state_path = /opt/stack/data/cinder {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] storage_availability_zone = nova {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] storage_protocol = iSCSI {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] syslog_log_facility = LOG_USER {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] target_helper = lioadm {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] target_ip_address = 192.168.122.117 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] target_port = 3260 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] target_protocol = iscsi {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] target_secondary_ip_addresses = [] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] trace_flags = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] transfer_api_class = cinder.transfer.api.API {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] transport_url = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] until_refresh = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] use_chap_auth = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] use_default_quota_class = True {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] use_journal = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] use_json = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] use_multipath_for_image_xfer = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] use_stderr = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] use_syslog = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] verify_glance_signatures = enabled {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] volume_api_class = cinder.volume.api.API {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] volume_backend_name = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] volume_clear = zero {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] volume_clear_ionice = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] volume_clear_size = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] volume_copy_bps_limit = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] volume_dd_blocksize = 1M {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] volume_name_template = volume-%s {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] volume_service_inithost_offload = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] volume_usage_audit_period = month {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] zoning_mode = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_concurrency.disable_process_locking = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.admin_password = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.admin_token = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.admin_user = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.auth_admin_prefix = {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.auth_port = 35357 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.auth_protocol = https {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.auth_section = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.auth_type = password {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.auth_uri = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.auth_version = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.cache = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.certfile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.delay_auth_decision = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.http_connect_timeout = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.identity_uri = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.include_service_catalog = True {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.insecure = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.interface = public {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.keyfile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.memcache_password = {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72575]: INFO cinder.volume.manager [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.memcache_username = {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.region_name = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.service_token_roles_required = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.service_type = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.token_cache_time = 300 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.117/identity {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.backend = dogpile.cache.null {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.backend_argument = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.backend_expiration_time = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.config_prefix = cache.oslo {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.debug_cache_backend = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.enable_retry_client = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.enable_socket_keepalive = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.enabled = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.enforce_fips_mode = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.expiration_time = 600 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.hashclient_retry_attempts = 2 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.memcache_dead_retry = 300 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.memcache_pool_maxsize = 10 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.memcache_sasl_enabled = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.password = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.proxies = [] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.redis_db = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.redis_sentinel_service_name = mymaster {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.redis_server = localhost:6379 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.retry_attempts = 2 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.retry_delay = 0.0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.socket_keepalive_count = 1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.socket_keepalive_idle = 1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.socket_keepalive_interval = 1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.socket_timeout = 1.0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.tls_allowed_ciphers = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.tls_cafile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.tls_certfile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.tls_enabled = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.tls_keyfile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cache.username = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] coordination.backend_url = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.asyncio_connection = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.asyncio_slave_connection = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.backend = sqlalchemy {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.connection = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.connection_debug = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.connection_parameters = {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.connection_recycle_time = 3600 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.connection_trace = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.db_inc_retry_interval = True {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.db_max_retries = 20 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.db_max_retry_interval = 10 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.db_retry_interval = 1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.max_overflow = 50 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.max_pool_size = 5 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.max_retries = 10 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.mysql_wsrep_sync_wait = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.pool_timeout = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.retry_interval = 10 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.slave_connection = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.sqlite_synchronous = True {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.synchronous_reader = True {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] database.use_db_reconnect = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] profiler.connection_string = messaging:// {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] profiler.enabled = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] profiler.es_doc_type = notification {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] profiler.es_scroll_size = 10000 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] profiler.es_scroll_time = 2m {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] profiler.filter_error_trace = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] profiler.hmac_keys = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] profiler.sentinel_service_name = mymaster {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] profiler.socket_timeout = 0.1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] profiler.trace_requests = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] profiler.trace_sqlalchemy = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] profiler_jaeger.process_tags = {} {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] profiler_jaeger.service_name_prefix = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] profiler_otlp.service_name_prefix = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_policy.enforce_new_defaults = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: WARNING oslo_config.cfg [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_policy.enforce_scope = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_policy.policy_default_rule = default {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_policy.policy_file = policy.yaml {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_policy.remote_timeout = 60.0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] privsep_osbrick.group = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] privsep_osbrick.helper_command = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] privsep_osbrick.user = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cinder_sys_admin.group = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cinder_sys_admin.helper_command = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] cinder_sys_admin.user = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] service_user.auth_section = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] service_user.auth_type = password {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] service_user.cafile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] service_user.certfile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] service_user.collect_timing = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] service_user.insecure = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] service_user.keyfile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] service_user.send_service_user_token = True {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] service_user.split_loggers = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] service_user.timeout = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance.auth_section = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance.auth_type = password {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance.certfile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance.collect_timing = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance.insecure = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance.keyfile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance.region_name = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.062s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance.split_loggers = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] glance.timeout = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.backend_availability_zone = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.chap_password = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.chap_username = {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.disk_geometry = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.driver_client_cert = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.driver_client_cert_key = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.driver_data_namespace = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.driver_use_ssl = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.enable_unsupported_driver = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.extra_capabilities = {} {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.filter_function = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.goodness_function = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.iscsi_target_flags = {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.iscsi_write_cache = on {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.iser_helper = tgtadm {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.iser_ip_address = 192.168.122.117 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.iser_port = 3260 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.lvm_mirrors = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.lvm_share_target = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.lvm_type = auto {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.num_shell_tries = 3 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.nvmet_port_id = 1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.replication_device = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.report_discard_supported = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.reserved_percentage = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.scst_target_driver = iscsi {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.scst_target_iqn_name = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.storage_protocol = iSCSI {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.target_helper = tgtadm {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.target_ip_address = 192.168.122.117 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.target_port = 3260 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.target_protocol = iscsi {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.trace_flags = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.unique_fqdn_network = True {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.use_chap_auth = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.volume_backend_name = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.volume_clear = zero {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.volume_clear_ionice = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.volume_clear_size = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.volume_group = cinder-volumes {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_reports.file_event_handler = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_reports.log_dir = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.backend_availability_zone = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.backend_host = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.chap_password = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.chap_username = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.chiscsi_conf = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.disk_geometry = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.driver_client_cert = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.driver_data_namespace = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.driver_use_ssl = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.extra_capabilities = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.filter_function = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.goodness_function = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.iser_helper = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.iser_ip_address = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.iser_port = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.iser_target_prefix = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.lvm_conf_file = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.lvm_mirrors = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.lvm_share_target = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.lvm_type = auto {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.num_shell_tries = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.nvmet_port_id = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.replication_device = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.report_discard_supported = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.reserved_percentage = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.scst_target_driver = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.storage_protocol = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.target_helper = lioadm {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.target_ip_address = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.target_port = 3260 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.target_protocol = iscsi {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.trace_flags = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.use_chap_auth = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.volume_clear = zero {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.volume_clear_size = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] lvmdriver-1.volumes_dir = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.ssl = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.ssl_version = {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_notifications.driver = [] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_notifications.retry = -1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] oslo_messaging_notifications.transport_url = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] key_manager.fixed_key = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican.barbican_api_version = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican.barbican_endpoint = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican.barbican_endpoint_type = public {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican.barbican_region_name = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican.cafile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican.certfile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican.collect_timing = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican.insecure = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican.keyfile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican.number_of_retries = 60 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican.retry_delay = 1 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican.send_service_user_token = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican.split_loggers = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican.timeout = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican.verify_ssl = True {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican.verify_ssl_path = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican_service_user.auth_section = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican_service_user.auth_type = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican_service_user.cafile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican_service_user.certfile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican_service_user.collect_timing = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican_service_user.insecure = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican_service_user.keyfile = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican_service_user.split_loggers = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] barbican_service_user.timeout = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] vault.approle_role_id = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] vault.approle_secret_id = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] vault.kv_mountpoint = secret {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] vault.kv_path = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] vault.kv_version = 2 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] vault.namespace = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] vault.root_token_id = **** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] vault.ssl_ca_crt_file = None {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] vault.timeout = 60.0 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] vault.use_ssl = False {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:00:45 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] ******************************************************************************** {{(pid=72468) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 07 06:00:45 devstack sudo[72579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 07 06:00:45 devstack sudo[72579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:46 devstack sudo[72579]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:46 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.581s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:46 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:46 devstack sudo[72693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:00:46 devstack sudo[72693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:46 devstack sudo[72693]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:46 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.507s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:46 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:00:46 devstack cinder-volume[72575]: INFO cinder.brick.local_dev.lvm [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 07 06:00:46 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:47 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:47 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:47 devstack sudo[72915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 07 06:00:47 devstack sudo[72915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:47 devstack sudo[72915]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:47 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.554s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:47 devstack cinder-volume[72575]: DEBUG cinder.brick.local_dev.lvm [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72575) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 07 06:00:47 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:47 devstack sudo[73077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:00:47 devstack sudo[73077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:48 devstack sudo[73077]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:48 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.957s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:48 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:48 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:48 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:48 devstack sudo[73235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:00:48 devstack sudo[73235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:49 devstack sudo[73235]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:49 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.458s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:49 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:49 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:49 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:49 devstack sudo[73276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 07 06:00:49 devstack sudo[73276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:49 devstack sudo[73276]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:49 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.454s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:49 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:49 devstack sudo[73281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 07 06:00:49 devstack sudo[73281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:49 devstack sudo[73281]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:49 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:49 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:49 devstack sudo[73286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 07 06:00:49 devstack sudo[73286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:50 devstack sudo[73286]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:50 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:50 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:50 devstack sudo[73289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:00:50 devstack sudo[73289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:50 devstack sudo[73289]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:50 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:50 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:50 devstack sudo[73297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:00:50 devstack sudo[73297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:51 devstack sudo[73297]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:51 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.458s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:51 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:51 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:51 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:51 devstack sudo[73301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:00:51 devstack sudo[73301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:51 devstack sudo[73301]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:51 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.470s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:51 devstack cinder-volume[72575]: INFO cinder.volume.drivers.lvm [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 07 06:00:51 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:51 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:51 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:51 devstack sudo[73310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:00:51 devstack sudo[73310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:52 devstack sudo[73310]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:52 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.708s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:52 devstack cinder-volume[72575]: DEBUG cinder.volume.drivers.lvm [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Updating volume stats {{(pid=72575) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 07 06:00:52 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:52 devstack sudo[73423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 07 06:00:52 devstack sudo[73423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:53 devstack sudo[73423]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:53 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:53 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:53 devstack sudo[73564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:00:53 devstack sudo[73564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:53 devstack sudo[73564]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:53 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:53 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:53 devstack sudo[73567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:00:53 devstack sudo[73567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:53 devstack sudo[73567]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:53 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.424s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:53 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:53 devstack sudo[73571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:00:53 devstack sudo[73571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:54 devstack sudo[73571]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:54 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:54 devstack cinder-volume[72575]: INFO cinder.volume.driver [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Driver hasn't implemented _init_vendor_properties() Apr 07 06:00:54 devstack cinder-volume[72575]: DEBUG cinder.volume.driver [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72575) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 07 06:00:54 devstack cinder-volume[72575]: DEBUG oslo_db.sqlalchemy.engines [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72575) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:00:54 devstack cinder-volume[72575]: DEBUG dbcounter [-] [72575] Writer thread running {{(pid=72575) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 07 06:00:54 devstack cinder-volume[72575]: DEBUG cinder.db.sqlalchemy.api [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Building query based on filter {{(pid=72575) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 07 06:00:54 devstack cinder-volume[72575]: DEBUG cinder.image.image_utils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72575) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 07 06:00:54 devstack cinder-volume[72575]: INFO cinder.keymgr.migration [None req-62ced824-a973-4941-bd8e-50045f65384b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 07 06:00:54 devstack cinder-volume[72575]: DEBUG cinder.volume.drivers.lvm [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Updating volume stats {{(pid=72575) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 07 06:00:54 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:54 devstack sudo[73575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 07 06:00:54 devstack sudo[73575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:54 devstack sudo[73575]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:54 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:54 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:54 devstack sudo[73581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:00:54 devstack sudo[73581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:55 devstack sudo[73581]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:55 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:55 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:55 devstack sudo[73585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:00:55 devstack sudo[73585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:55 devstack cinder-volume[72468]: DEBUG dbcounter [-] [72468] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72468) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:00:55 devstack sudo[73585]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:55 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.466s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:55 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:55 devstack sudo[73590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:00:55 devstack sudo[73590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:56 devstack sudo[73590]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:56 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:56 devstack cinder-volume[72575]: DEBUG cinder.manager [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Notifying Schedulers of capabilities ... {{(pid=72575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:00:56 devstack cinder-volume[72575]: INFO cinder.volume.manager [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Driver initialization completed successfully. Apr 07 06:00:56 devstack cinder-volume[72575]: INFO cinder.manager [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Initiating service 2 cleanup Apr 07 06:00:56 devstack cinder-volume[72575]: INFO cinder.manager [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Service 2 cleanup completed. Apr 07 06:00:56 devstack cinder-volume[72575]: DEBUG cinder.service [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Creating RPC server for service cinder-volume {{(pid=72575) start /opt/stack/cinder/cinder/service.py:231}} Apr 07 06:00:56 devstack cinder-volume[72575]: DEBUG cinder.service [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72575) start /opt/stack/cinder/cinder/service.py:237}} Apr 07 06:00:56 devstack cinder-volume[72575]: INFO cinder.volume.manager [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 07 06:00:56 devstack cinder-volume[72575]: DEBUG cinder.volume.drivers.lvm [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Updating volume stats {{(pid=72575) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 07 06:00:56 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:56 devstack sudo[73594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 07 06:00:56 devstack sudo[73594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:56 devstack sudo[73594]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:56 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:56 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:56 devstack sudo[73601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:00:56 devstack sudo[73601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:57 devstack sudo[73601]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:57 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:57 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:57 devstack sudo[73604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:00:57 devstack sudo[73604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:57 devstack sudo[73604]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:57 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.454s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:57 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:00:57 devstack sudo[73661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:00:57 devstack sudo[73661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:00:58 devstack sudo[73661]: pam_unix(sudo:session): session closed for user root Apr 07 06:00:58 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:00:58 devstack cinder-volume[72575]: INFO cinder.volume.manager [None req-6685d1bd-bcf6-4eeb-9d7d-42aa0b32fb38 None None] Driver post RPC initialization completed successfully. Apr 07 06:01:08 devstack cinder-volume[72575]: DEBUG dbcounter [-] [72575] Writing DB stats cinder:SELECT=2 {{(pid=72575) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:01:08 devstack cinder-volume[72575]: DEBUG dbcounter [-] [72575] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72575) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:02:08 devstack cinder-volume[72575]: DEBUG oslo_service.periodic_task [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72575) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:02:08 devstack cinder-volume[72575]: DEBUG cinder.volume.drivers.lvm [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Updating volume stats {{(pid=72575) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 07 06:02:08 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:02:08 devstack sudo[78408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 07 06:02:08 devstack sudo[78408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:02:08 devstack sudo[78408]: pam_unix(sudo:session): session closed for user root Apr 07 06:02:08 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:02:08 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:02:08 devstack sudo[78411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:02:08 devstack sudo[78411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:02:09 devstack sudo[78411]: pam_unix(sudo:session): session closed for user root Apr 07 06:02:09 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:02:09 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:02:09 devstack sudo[78414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:02:09 devstack sudo[78414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:02:09 devstack sudo[78414]: pam_unix(sudo:session): session closed for user root Apr 07 06:02:09 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.446s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:02:09 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:02:09 devstack sudo[78420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:02:09 devstack sudo[78420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:02:10 devstack sudo[78420]: pam_unix(sudo:session): session closed for user root Apr 07 06:02:10 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:02:10 devstack cinder-volume[72575]: DEBUG cinder.manager [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Notifying Schedulers of capabilities ... {{(pid=72575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:03:08 devstack cinder-volume[72575]: DEBUG oslo_service.periodic_task [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72575) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:03:08 devstack cinder-volume[72575]: DEBUG cinder.volume.drivers.lvm [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Updating volume stats {{(pid=72575) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 07 06:03:08 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:03:08 devstack cinder-volume[72575]: DEBUG dbcounter [-] [72575] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72575) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:03:08 devstack sudo[79599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 07 06:03:08 devstack sudo[79599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:03:08 devstack sudo[79599]: pam_unix(sudo:session): session closed for user root Apr 07 06:03:08 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:03:08 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:03:08 devstack sudo[79635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:03:08 devstack sudo[79635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:03:09 devstack sudo[79635]: pam_unix(sudo:session): session closed for user root Apr 07 06:03:09 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:03:09 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:03:09 devstack sudo[79659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:03:09 devstack sudo[79659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:03:09 devstack sudo[79659]: pam_unix(sudo:session): session closed for user root Apr 07 06:03:09 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.474s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:03:09 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:03:09 devstack sudo[79677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:03:09 devstack sudo[79677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:03:10 devstack sudo[79677]: pam_unix(sudo:session): session closed for user root Apr 07 06:03:10 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.499s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:03:10 devstack cinder-volume[72575]: DEBUG cinder.manager [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Notifying Schedulers of capabilities ... {{(pid=72575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:04:08 devstack cinder-volume[72575]: DEBUG oslo_service.periodic_task [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72575) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:04:08 devstack cinder-volume[72575]: DEBUG cinder.volume.drivers.lvm [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Updating volume stats {{(pid=72575) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 07 06:04:08 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:08 devstack sudo[81137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 07 06:04:08 devstack sudo[81137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:04:08 devstack sudo[81137]: pam_unix(sudo:session): session closed for user root Apr 07 06:04:08 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.481s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:08 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:08 devstack sudo[81141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:04:08 devstack sudo[81141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:04:09 devstack sudo[81141]: pam_unix(sudo:session): session closed for user root Apr 07 06:04:09 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:09 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:09 devstack sudo[81144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 07 06:04:09 devstack sudo[81144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:04:09 devstack sudo[81144]: pam_unix(sudo:session): session closed for user root Apr 07 06:04:09 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.472s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:09 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:09 devstack sudo[81159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 07 06:04:09 devstack sudo[81159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:04:10 devstack sudo[81159]: pam_unix(sudo:session): session closed for user root Apr 07 06:04:10 devstack cinder-volume[72575]: DEBUG oslo_concurrency.processutils [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=72575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:10 devstack cinder-volume[72575]: DEBUG cinder.manager [None req-83133219-bb76-47ae-96a8-6d7ebd8eaf97 None None] Notifying Schedulers of capabilities ... {{(pid=72575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:04:38 devstack cinder-volume[72468]: INFO oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Caught SIGTERM, stopping children Apr 07 06:04:38 devstack cinder-volume[72468]: DEBUG oslo_concurrency.lockutils [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Acquiring lock "singleton_lock" {{(pid=72468) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 07 06:04:38 devstack cinder-volume[72468]: DEBUG oslo_concurrency.lockutils [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Acquired lock "singleton_lock" {{(pid=72468) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 07 06:04:38 devstack cinder-volume[72468]: DEBUG oslo_concurrency.lockutils [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Releasing lock "singleton_lock" {{(pid=72468) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 07 06:04:38 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Stop services. {{(pid=72468) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 07 06:04:38 devstack cinder-volume[72468]: DEBUG oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Killing children. {{(pid=72468) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 07 06:04:38 devstack cinder-volume[72468]: INFO oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Waiting on 1 children to exit Apr 07 06:04:41 devstack cinder-volume[72575]: DEBUG oslo_concurrency.lockutils [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Acquiring lock "singleton_lock" {{(pid=72575) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 07 06:04:41 devstack cinder-volume[72575]: DEBUG oslo_concurrency.lockutils [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Acquired lock "singleton_lock" {{(pid=72575) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 07 06:04:41 devstack cinder-volume[72575]: DEBUG oslo_concurrency.lockutils [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Releasing lock "singleton_lock" {{(pid=72575) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 07 06:04:41 devstack cinder-volume[72575]: WARNING amqp [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 07 06:04:41 devstack cinder-volume[72575]: WARNING amqp [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 07 06:04:41 devstack cinder-volume[72468]: INFO oslo_service.backend._eventlet.service [None req-b74121d4-9c22-472b-97ff-150451e275ce None None] Child 72575 exited with status 0 Apr 07 06:04:44 devstack cinder-volume[81852]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81852) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 07 06:04:44 devstack cinder-volume[81852]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81852) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 07 06:04:44 devstack cinder-volume[81852]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81852) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 07 06:04:44 devstack cinder-volume[81852]: INFO dbcounter [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Registered counter for database cinder Apr 07 06:04:44 devstack cinder-volume[81852]: DEBUG oslo_db.sqlalchemy.engines [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81852) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:04:44 devstack cinder-volume[81852]: DEBUG dbcounter [-] [81852] Writer thread running {{(pid=81852) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 07 06:04:44 devstack cinder-volume[81852]: INFO cinder.rpc [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 07 06:04:44 devstack cinder-volume[81852]: INFO cinder.rpc [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 07 06:04:44 devstack cinder-volume[81852]: DEBUG oslo_db.sqlalchemy.engines [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81852) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:04:44 devstack cinder-volume[81852]: INFO cinder.volume.manager [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Determined volume DB was empty at startup. Apr 07 06:04:44 devstack cinder-volume[81852]: DEBUG cinder.volume.manager [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81852) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 07 06:04:44 devstack cinder-volume[81852]: INFO cinder.volume.manager [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 07 06:04:44 devstack cinder-volume[81852]: WARNING stevedore.named [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 07 06:04:44 devstack cinder-volume[81852]: WARNING castellan.key_manager [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 07 06:04:44 devstack cinder-volume[81852]: WARNING cinder.keymgr.conf_key_mgr [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 07 06:04:44 devstack cinder-volume[81852]: INFO cinder.volume.manager [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 07 06:04:44 devstack cinder-volume[81852]: DEBUG oslo_db.sqlalchemy.engines [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81852) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:04:45 devstack cinder-volume[81852]: INFO oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Starting 1 workers Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Started child 81931 {{(pid=81852) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Full set of CONF: {{(pid=81852) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] ******************************************************************************** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Configuration options gathered from: {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 07 06:04:45 devstack cinder-volume[81931]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] ================================================================================ {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] allow_availability_zone_fallback = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] allow_compression_on_image_upload = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] allowed_direct_url_schemes = [] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] api_rate_limit = True {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] auth_strategy = keystone {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_availability_zone = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_host = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_name = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_stats_polling_interval = 60 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backup_api_class = cinder.backup.api.API {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backup_name_template = backup-%s {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backup_use_same_host = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backup_use_temp_snapshot = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] chap_password = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] chap_username = {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cinder_internal_tenant_project_id = 5093758e43904687b9852073a27101f9 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cinder_internal_tenant_user_id = 9dcda862e7db415e9d50a199a862b6dd {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cluster = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] compression_format = gzip {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] compute_api_class = cinder.compute.nova.API {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] config_dir = [] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] config_source = [] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] control_exchange = openstack {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] debug = True {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] default_availability_zone = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] default_group_type = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] default_volume_type = QuobyteHD {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] disk_geometry = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] driver_client_cert = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] driver_client_cert_key = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] driver_data_namespace = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] driver_ssl_cert_path = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] driver_ssl_cert_verify = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] driver_use_ssl = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] enable_new_services = True {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] enable_unsupported_driver = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] enabled_backends = ['QuobyteHD'] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] enforce_multipath_for_image_xfer = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] filter_function = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance_api_insecure = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance_api_servers = ['http://192.168.122.117/image'] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance_api_ssl_compression = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance_ca_certificates_file = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance_catalog_info = image:glance:publicURL {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance_certfile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance_keyfile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance_num_retries = 3 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance_request_timeout = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] goodness_function = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] graceful_shutdown_timeout = 5 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] group_api_class = cinder.group.api.API {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] host = devstack {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] image_compress_on_upload = True {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] image_conversion_address_space_limit = 1 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] image_conversion_cpu_limit = 60 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] image_conversion_disable = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] image_upload_use_cinder_backend = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] image_upload_use_internal_tenant = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] image_volume_cache_enabled = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] image_volume_cache_max_count = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] image_volume_cache_max_size_gb = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] init_host_max_objects_retrieval = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] instance_format = [instance: %(uuid)s] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] iscsi_target_flags = {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] iscsi_write_cache = on {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] iser_helper = tgtadm {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] iser_ip_address = 192.168.122.117 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81931]: INFO cinder.volume.manager [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Starting volume driver QuobyteDriver (1.1.14) Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] iser_port = 3260 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81931]: DEBUG cinder.volume.drivers.remotefs [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81931) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] log_color = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] log_config_append = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] log_dir = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] log_file = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] log_options = True {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] log_rotate_interval = 1 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] log_rotate_interval_type = days {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] log_rotation_type = none {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] max_age = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] max_logfile_count = 30 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] max_logfile_size_mb = 200 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] max_over_subscription_ratio = 20.0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] message_reap_interval = 86400 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] message_ttl = 2592000 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] migration_create_volume_timeout_secs = 300 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] monkey_patch = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] monkey_patch_modules = [] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] my_ip = 192.168.122.117 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] no_snapshot_gb_quota = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] num_iser_scan_tries = 3 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] num_shell_tries = 3 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] num_volume_device_scan_tries = 3 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] nvmeof_conn_info_version = 1 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] nvmet_ns_id = 10 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] nvmet_port_id = 1 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] osapi_max_limit = 1000 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] osapi_volume_ext_list = [] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] osapi_volume_listen = 0.0.0.0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] osapi_volume_listen_port = 8776 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] osapi_volume_use_ssl = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] osapi_volume_workers = 2 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] per_volume_size_limit = -1 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] periodic_fuzzy_delay = 60 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] periodic_interval = 60 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] project_id_regex = [0-9a-f\-]+ {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] public_endpoint = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] publish_errors = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] quota_backup_gigabytes = 1000 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] quota_backups = 10 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] quota_gigabytes = 1000 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] quota_groups = 10 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] quota_snapshots = 10 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] quota_volumes = 10 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] rate_limit_burst = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] rate_limit_except_level = CRITICAL {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] rate_limit_interval = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] reinit_driver_count = 3 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] replication_device = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] report_discard_supported = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] report_interval = 120 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] reservation_clean_interval = 86400 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] reservation_expire = 86400 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] reserved_image_namespaces = [] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] reserved_percentage = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] rpc_response_timeout = 120 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] run_external_periodic_tasks = True {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] scst_target_driver = iscsi {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] scst_target_iqn_name = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] service_down_time = 720 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] shell_completion = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] snapshot_name_template = snapshot-%s {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] split_loggers = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] state_path = /opt/stack/data/cinder {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] storage_availability_zone = nova {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] storage_protocol = iSCSI {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] syslog_log_facility = LOG_USER {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] target_helper = lioadm {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] target_ip_address = 192.168.122.117 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] target_port = 3260 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] target_protocol = iscsi {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] target_secondary_ip_addresses = [] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] trace_flags = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] transfer_api_class = cinder.transfer.api.API {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] transport_url = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] until_refresh = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] use_chap_auth = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] use_default_quota_class = True {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] use_journal = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] use_json = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] use_multipath_for_image_xfer = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] use_stderr = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] use_syslog = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] verify_glance_signatures = enabled {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] volume_api_class = cinder.volume.api.API {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] volume_backend_name = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] volume_clear = zero {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] volume_clear_ionice = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] volume_clear_size = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] volume_copy_bps_limit = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] volume_dd_blocksize = 1M {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] volume_name_template = volume-%s {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] volume_service_inithost_offload = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] volume_usage_audit_period = month {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] zoning_mode = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_concurrency.disable_process_locking = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.admin_password = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.admin_token = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.admin_user = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.auth_admin_prefix = {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.auth_port = 35357 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.auth_protocol = https {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.auth_section = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.auth_type = password {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.auth_uri = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.auth_version = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.cache = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.certfile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.delay_auth_decision = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.http_connect_timeout = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.identity_uri = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.include_service_catalog = True {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.insecure = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81931]: DEBUG cinder.volume.drivers.quobyte [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81931) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 07 06:04:45 devstack cinder-volume[81931]: WARNING cinder.volume.drivers.quobyte [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 07 06:04:45 devstack cinder-volume[81931]: WARNING cinder.volume.drivers.quobyte [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.interface = public {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.keyfile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.memcache_password = {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81931]: DEBUG oslo_concurrency.processutils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Running cmd (subprocess): mount.quobyte {{(pid=81931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.memcache_username = {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.region_name = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.service_token_roles_required = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.service_type = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.token_cache_time = 300 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.117/identity {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.backend = dogpile.cache.null {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.backend_argument = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.backend_expiration_time = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.config_prefix = cache.oslo {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.debug_cache_backend = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.enable_retry_client = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.enable_socket_keepalive = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.enabled = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.enforce_fips_mode = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.expiration_time = 600 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.hashclient_retry_attempts = 2 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.memcache_dead_retry = 300 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.memcache_pool_maxsize = 10 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.memcache_sasl_enabled = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.password = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.proxies = [] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.redis_db = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.redis_sentinel_service_name = mymaster {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.redis_server = localhost:6379 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.retry_attempts = 2 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.retry_delay = 0.0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.socket_keepalive_count = 1 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.socket_keepalive_idle = 1 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.socket_keepalive_interval = 1 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.socket_timeout = 1.0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.tls_allowed_ciphers = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.tls_cafile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.tls_certfile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.tls_enabled = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.tls_keyfile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cache.username = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] coordination.backend_url = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.asyncio_connection = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.asyncio_slave_connection = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.backend = sqlalchemy {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.connection = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.connection_debug = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.connection_parameters = {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.connection_recycle_time = 3600 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.connection_trace = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.db_inc_retry_interval = True {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.db_max_retries = 20 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.db_max_retry_interval = 10 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.db_retry_interval = 1 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.max_overflow = 50 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.max_pool_size = 5 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.max_retries = 10 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.mysql_wsrep_sync_wait = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.pool_timeout = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.retry_interval = 10 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.slave_connection = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.sqlite_synchronous = True {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.synchronous_reader = True {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] database.use_db_reconnect = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] profiler.connection_string = messaging:// {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] profiler.enabled = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] profiler.es_doc_type = notification {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] profiler.es_scroll_size = 10000 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] profiler.es_scroll_time = 2m {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] profiler.filter_error_trace = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] profiler.hmac_keys = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] profiler.sentinel_service_name = mymaster {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] profiler.socket_timeout = 0.1 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] profiler.trace_requests = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] profiler.trace_sqlalchemy = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] profiler_jaeger.process_tags = {} {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] profiler_jaeger.service_name_prefix = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] profiler_otlp.service_name_prefix = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_policy.enforce_new_defaults = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: WARNING oslo_config.cfg [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_policy.enforce_scope = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_policy.policy_default_rule = default {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_policy.policy_file = policy.yaml {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_policy.remote_timeout = 60.0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] privsep_osbrick.group = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] privsep_osbrick.helper_command = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] privsep_osbrick.user = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cinder_sys_admin.group = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cinder_sys_admin.helper_command = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] cinder_sys_admin.user = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] service_user.auth_section = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] service_user.auth_type = password {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] service_user.cafile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] service_user.certfile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] service_user.collect_timing = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] service_user.insecure = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] service_user.keyfile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] service_user.send_service_user_token = True {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] service_user.split_loggers = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] service_user.timeout = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance.auth_section = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance.auth_type = password {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance.certfile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance.collect_timing = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance.insecure = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance.keyfile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance.region_name = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance.split_loggers = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] glance.timeout = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.backend_availability_zone = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.chap_password = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.chap_username = {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.disk_geometry = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.driver_client_cert = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.driver_client_cert_key = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.driver_data_namespace = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.driver_use_ssl = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.enable_unsupported_driver = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.extra_capabilities = {} {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.filter_function = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.goodness_function = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.iscsi_target_flags = {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.iscsi_write_cache = on {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.iser_helper = tgtadm {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.iser_ip_address = 192.168.122.117 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.iser_port = 3260 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.nas_host = {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.nas_login = admin {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.nas_mount_options = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.nas_password = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.nas_private_key = {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.nas_share_path = {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.nas_ssh_port = 22 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.num_shell_tries = 3 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.nvmet_port_id = 1 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.quobyte_client_cfg = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.quobyte_volume_url = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.replication_device = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.report_discard_supported = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.reserved_percentage = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.scst_target_driver = iscsi {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.scst_target_iqn_name = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.storage_protocol = iSCSI {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.target_helper = tgtadm {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.target_ip_address = 192.168.122.117 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.target_port = 3260 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.target_protocol = iscsi {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.trace_flags = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.unique_fqdn_network = True {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.use_chap_auth = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.volume_backend_name = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.volume_clear = zero {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.volume_clear_ionice = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.volume_clear_size = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_reports.file_event_handler = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_reports.log_dir = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.backend_availability_zone = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.backend_host = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.chap_password = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.chap_username = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.chiscsi_conf = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.disk_geometry = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.driver_client_cert = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.driver_client_cert_key = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.driver_data_namespace = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.driver_use_ssl = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.extra_capabilities = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.filter_function = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.goodness_function = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.iscsi_target_flags = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.iscsi_write_cache = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.iser_helper = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.iser_ip_address = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.iser_port = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.iser_target_prefix = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.nas_host = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.nas_login = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack quobyte-client[81937]: Reading configuration file: /etc/quobyte/client.cfg Apr 07 06:04:45 devstack quobyte-client[81937]: Invalid parameters found, error: missing mount point. Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.nas_mount_options = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack quobyte-client[81937]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 07 06:04:45 devstack quobyte-client[81937]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.nas_password = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.nas_private_key = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.nas_share_path = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.nas_ssh_port = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81931]: DEBUG oslo_concurrency.processutils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] CMD "mount.quobyte" returned: 1 in 0.151s {{(pid=81931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81931]: DEBUG oslo_concurrency.lockutils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81931]: DEBUG oslo_concurrency.lockutils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.num_shell_tries = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81931]: DEBUG cinder.volume.drivers.quobyte [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=81931) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.nvmet_ns_id = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81931]: INFO cinder.volume.drivers.quobyte [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 ... Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.nvmet_port_id = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81931]: DEBUG oslo_concurrency.processutils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 -c /etc/quobyte/client-cinder.cfg {{(pid=81931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.replication_device = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.report_discard_supported = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.reserved_percentage = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.scst_target_driver = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.storage_protocol = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.target_helper = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.target_ip_address = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.target_port = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.target_prefix = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.target_protocol = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.trace_flags = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.unique_fqdn_network = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.use_chap_auth = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.volume_clear = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.volume_clear_ionice = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.volume_clear_size = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] QuobyteHD.volumes_dir = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.ssl = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.ssl_version = {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_notifications.driver = [] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_notifications.retry = -1 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] oslo_messaging_notifications.transport_url = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack sudo[81938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 -c /etc/quobyte/client-cinder.cfg Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] key_manager.fixed_key = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack sudo[81938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican.barbican_api_version = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican.barbican_endpoint = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican.barbican_endpoint_type = public {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican.barbican_region_name = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican.cafile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican.certfile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican.collect_timing = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican.insecure = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican.keyfile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican.number_of_retries = 60 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican.retry_delay = 1 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican.send_service_user_token = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican.split_loggers = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican.timeout = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican.verify_ssl = True {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican.verify_ssl_path = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican_service_user.auth_section = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican_service_user.auth_type = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican_service_user.cafile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican_service_user.certfile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican_service_user.collect_timing = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican_service_user.insecure = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican_service_user.keyfile = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican_service_user.split_loggers = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] barbican_service_user.timeout = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] vault.approle_role_id = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] vault.approle_secret_id = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] vault.kv_mountpoint = secret {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] vault.kv_path = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] vault.kv_version = 2 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] vault.namespace = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] vault.root_token_id = **** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] vault.ssl_ca_crt_file = None {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] vault.timeout = 60.0 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] vault.use_ssl = False {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:45 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] ******************************************************************************** {{(pid=81852) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 07 06:04:46 devstack sudo[81938]: pam_unix(sudo:session): session closed for user root Apr 07 06:04:46 devstack cinder-volume[81931]: DEBUG oslo_concurrency.processutils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 1.034s {{(pid=81931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:46 devstack cinder-volume[81931]: INFO cinder.volume.drivers.quobyte [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 succeeded Apr 07 06:04:46 devstack cinder-volume[81931]: DEBUG cinder.volume.drivers.quobyte [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=81931) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:04:46 devstack cinder-volume[81931]: DEBUG oslo_concurrency.lockutils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 1.042s {{(pid=81931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:04:46 devstack cinder-volume[81931]: DEBUG oslo_concurrency.processutils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=81931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:46 devstack sudo[82040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:04:46 devstack sudo[82040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:04:46 devstack sudo[82040]: pam_unix(sudo:session): session closed for user root Apr 07 06:04:46 devstack cinder-volume[81931]: DEBUG oslo_concurrency.processutils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.424s {{(pid=81931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:46 devstack cinder-volume[81931]: INFO cinder.volume.driver [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Driver hasn't implemented _init_vendor_properties() Apr 07 06:04:46 devstack cinder-volume[81931]: DEBUG cinder.volume.driver [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7451705932617, 'free_capacity_gb': 1775.7451705932617, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81931) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 07 06:04:46 devstack cinder-volume[81931]: DEBUG oslo_db.sqlalchemy.engines [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81931) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:04:46 devstack cinder-volume[81931]: DEBUG dbcounter [-] [81931] Writer thread running {{(pid=81931) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 07 06:04:46 devstack cinder-volume[81931]: DEBUG cinder.db.sqlalchemy.api [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Building query based on filter {{(pid=81931) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 07 06:04:46 devstack cinder-volume[81931]: DEBUG cinder.image.image_utils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81931) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 07 06:04:46 devstack cinder-volume[81931]: INFO cinder.keymgr.migration [None req-56d06042-85c2-47ef-889c-1844d504b402 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 07 06:04:46 devstack cinder-volume[81931]: DEBUG oslo_concurrency.lockutils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:04:46 devstack cinder-volume[81931]: DEBUG oslo_concurrency.lockutils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:04:46 devstack cinder-volume[81931]: DEBUG cinder.volume.drivers.quobyte [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=81931) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:04:46 devstack cinder-volume[81931]: DEBUG cinder.volume.drivers.quobyte [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=81931) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:04:46 devstack cinder-volume[81931]: DEBUG oslo_concurrency.lockutils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:04:46 devstack cinder-volume[81931]: DEBUG oslo_concurrency.processutils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=81931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:46 devstack sudo[82043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:04:46 devstack sudo[82043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:04:47 devstack sudo[82043]: pam_unix(sudo:session): session closed for user root Apr 07 06:04:47 devstack cinder-volume[81931]: DEBUG oslo_concurrency.processutils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.413s {{(pid=81931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:47 devstack cinder-volume[81931]: DEBUG cinder.manager [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Notifying Schedulers of capabilities ... {{(pid=81931) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:04:47 devstack cinder-volume[81931]: INFO cinder.volume.manager [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Driver initialization completed successfully. Apr 07 06:04:47 devstack cinder-volume[81931]: INFO cinder.manager [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Initiating service 3 cleanup Apr 07 06:04:47 devstack cinder-volume[81931]: INFO cinder.manager [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Service 3 cleanup completed. Apr 07 06:04:47 devstack cinder-volume[81931]: DEBUG cinder.service [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Creating RPC server for service cinder-volume {{(pid=81931) start /opt/stack/cinder/cinder/service.py:231}} Apr 07 06:04:47 devstack cinder-volume[81931]: DEBUG cinder.service [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81931) start /opt/stack/cinder/cinder/service.py:237}} Apr 07 06:04:47 devstack cinder-volume[81931]: INFO cinder.volume.manager [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 07 06:04:47 devstack cinder-volume[81931]: DEBUG oslo_concurrency.lockutils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:04:47 devstack cinder-volume[81931]: DEBUG oslo_concurrency.lockutils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:04:47 devstack cinder-volume[81931]: DEBUG cinder.volume.drivers.quobyte [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=81931) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:04:47 devstack cinder-volume[81931]: DEBUG cinder.volume.drivers.quobyte [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=81931) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:04:47 devstack cinder-volume[81931]: DEBUG oslo_concurrency.lockutils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:04:47 devstack cinder-volume[81931]: DEBUG oslo_concurrency.processutils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=81931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:47 devstack sudo[82046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:04:47 devstack sudo[82046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:04:47 devstack sudo[82046]: pam_unix(sudo:session): session closed for user root Apr 07 06:04:47 devstack cinder-volume[81931]: DEBUG oslo_concurrency.processutils [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.463s {{(pid=81931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:47 devstack cinder-volume[81931]: INFO cinder.volume.manager [None req-33ccabbb-098d-4cae-a8d7-263d082474bf None None] Driver post RPC initialization completed successfully. Apr 07 06:04:51 devstack cinder-volume[81931]: DEBUG oslo_concurrency.lockutils [None req-515b5a6d-6936-4bcd-8c30-a45ba378b1df None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:04:51 devstack cinder-volume[81931]: DEBUG oslo_concurrency.lockutils [None req-515b5a6d-6936-4bcd-8c30-a45ba378b1df None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:04:51 devstack cinder-volume[81931]: DEBUG cinder.volume.drivers.quobyte [None req-515b5a6d-6936-4bcd-8c30-a45ba378b1df None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=81931) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:04:51 devstack cinder-volume[81931]: DEBUG cinder.volume.drivers.quobyte [None req-515b5a6d-6936-4bcd-8c30-a45ba378b1df None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=81931) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:04:51 devstack cinder-volume[81931]: DEBUG oslo_concurrency.lockutils [None req-515b5a6d-6936-4bcd-8c30-a45ba378b1df None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:04:51 devstack cinder-volume[81931]: DEBUG oslo_concurrency.processutils [None req-515b5a6d-6936-4bcd-8c30-a45ba378b1df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=81931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:51 devstack sudo[82186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:04:51 devstack sudo[82186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:04:51 devstack sudo[82186]: pam_unix(sudo:session): session closed for user root Apr 07 06:04:51 devstack cinder-volume[81931]: DEBUG oslo_concurrency.processutils [None req-515b5a6d-6936-4bcd-8c30-a45ba378b1df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.491s {{(pid=81931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:51 devstack cinder-volume[81931]: DEBUG cinder.manager [None req-515b5a6d-6936-4bcd-8c30-a45ba378b1df None None] Notifying Schedulers of capabilities ... {{(pid=81931) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:04:53 devstack cinder-volume[81852]: INFO oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Caught SIGTERM, stopping children Apr 07 06:04:53 devstack cinder-volume[81852]: DEBUG oslo_concurrency.lockutils [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Acquiring lock "singleton_lock" {{(pid=81852) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 07 06:04:53 devstack cinder-volume[81852]: DEBUG oslo_concurrency.lockutils [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Acquired lock "singleton_lock" {{(pid=81852) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 07 06:04:53 devstack cinder-volume[81852]: DEBUG oslo_concurrency.lockutils [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Releasing lock "singleton_lock" {{(pid=81852) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 07 06:04:53 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Stop services. {{(pid=81852) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 07 06:04:53 devstack cinder-volume[81852]: DEBUG oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Killing children. {{(pid=81852) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 07 06:04:53 devstack cinder-volume[81852]: INFO oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Waiting on 1 children to exit Apr 07 06:04:55 devstack cinder-volume[81931]: DEBUG oslo_concurrency.lockutils [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Acquiring lock "singleton_lock" {{(pid=81931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 07 06:04:55 devstack cinder-volume[81931]: DEBUG oslo_concurrency.lockutils [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Acquired lock "singleton_lock" {{(pid=81931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 07 06:04:55 devstack cinder-volume[81931]: DEBUG oslo_concurrency.lockutils [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Releasing lock "singleton_lock" {{(pid=81931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 07 06:04:55 devstack cinder-volume[81931]: WARNING amqp [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 07 06:04:55 devstack cinder-volume[81931]: WARNING amqp [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 07 06:04:55 devstack cinder-volume[81852]: INFO oslo_service.backend._eventlet.service [None req-dc9bf6c4-7134-4ae3-9f5a-dd073605158b None None] Child 81931 exited with status 0 Apr 07 06:04:58 devstack cinder-volume[82264]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82264) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 07 06:04:58 devstack cinder-volume[82264]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82264) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 07 06:04:58 devstack cinder-volume[82264]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82264) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 07 06:04:58 devstack cinder-volume[82264]: INFO dbcounter [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] Registered counter for database cinder Apr 07 06:04:58 devstack cinder-volume[82264]: DEBUG oslo_db.sqlalchemy.engines [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG dbcounter [-] [82264] Writer thread running {{(pid=82264) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 07 06:04:59 devstack cinder-volume[82264]: INFO cinder.rpc [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 07 06:04:59 devstack cinder-volume[82264]: INFO cinder.rpc [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_db.sqlalchemy.engines [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:04:59 devstack cinder-volume[82264]: INFO cinder.volume.manager [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] Determined volume DB was empty at startup. Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG cinder.volume.manager [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82264) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 07 06:04:59 devstack cinder-volume[82264]: WARNING stevedore.named [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 07 06:04:59 devstack cinder-volume[82264]: WARNING castellan.key_manager [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 07 06:04:59 devstack cinder-volume[82264]: WARNING cinder.keymgr.conf_key_mgr [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 07 06:04:59 devstack cinder-volume[82264]: INFO cinder.volume.manager [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_db.sqlalchemy.engines [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:04:59 devstack cinder-volume[82264]: INFO oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] Starting 1 workers Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] Started child 82475 {{(pid=82264) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] Full set of CONF: {{(pid=82264) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] ******************************************************************************** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] Configuration options gathered from: {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] ================================================================================ {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] allow_availability_zone_fallback = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] allow_compression_on_image_upload = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82475]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] allowed_direct_url_schemes = [] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] api_rate_limit = True {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] auth_strategy = keystone {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_availability_zone = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_host = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_name = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_stats_polling_interval = 60 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backup_api_class = cinder.backup.api.API {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backup_name_template = backup-%s {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backup_use_same_host = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backup_use_temp_snapshot = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] chap_password = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] chap_username = {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cinder_internal_tenant_project_id = 5093758e43904687b9852073a27101f9 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cinder_internal_tenant_user_id = 9dcda862e7db415e9d50a199a862b6dd {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cluster = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] compression_format = gzip {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] compute_api_class = cinder.compute.nova.API {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] config_dir = [] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] config_source = [] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] control_exchange = openstack {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] debug = True {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] default_availability_zone = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] default_group_type = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] default_volume_type = QuobyteHD {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] disk_geometry = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] driver_client_cert = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] driver_client_cert_key = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] driver_data_namespace = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] driver_ssl_cert_path = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] driver_ssl_cert_verify = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] driver_use_ssl = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] enable_new_services = True {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] enable_unsupported_driver = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] enabled_backends = ['QuobyteHD'] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] enforce_multipath_for_image_xfer = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] filter_function = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance_api_insecure = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance_api_servers = ['http://192.168.122.117/image'] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance_api_ssl_compression = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance_ca_certificates_file = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance_catalog_info = image:glance:publicURL {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance_certfile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance_keyfile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance_num_retries = 3 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance_request_timeout = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] goodness_function = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] graceful_shutdown_timeout = 5 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] group_api_class = cinder.group.api.API {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] host = devstack {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] image_compress_on_upload = True {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] image_conversion_address_space_limit = 1 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] image_conversion_cpu_limit = 60 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] image_conversion_disable = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] image_upload_use_cinder_backend = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] image_upload_use_internal_tenant = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] image_volume_cache_enabled = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] image_volume_cache_max_count = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] image_volume_cache_max_size_gb = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] init_host_max_objects_retrieval = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82475) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] instance_format = [instance: %(uuid)s] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] iscsi_target_flags = {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] iscsi_write_cache = on {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] iser_helper = tgtadm {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] iser_ip_address = 192.168.122.117 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] iser_port = 3260 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] log_color = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] log_config_append = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] log_dir = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] log_file = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] log_options = True {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] log_rotate_interval = 1 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] log_rotate_interval_type = days {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] log_rotation_type = none {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] max_age = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] max_logfile_count = 30 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] max_logfile_size_mb = 200 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] max_over_subscription_ratio = 20.0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] message_reap_interval = 86400 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] message_ttl = 2592000 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] migration_create_volume_timeout_secs = 300 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] monkey_patch = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] monkey_patch_modules = [] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] my_ip = 192.168.122.117 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] no_snapshot_gb_quota = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] num_iser_scan_tries = 3 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] num_shell_tries = 3 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] num_volume_device_scan_tries = 3 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] nvmeof_conn_info_version = 1 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] nvmet_ns_id = 10 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] nvmet_port_id = 1 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] osapi_max_limit = 1000 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] osapi_volume_ext_list = [] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] osapi_volume_listen_port = 8776 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] osapi_volume_use_ssl = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] osapi_volume_workers = 2 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] per_volume_size_limit = -1 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] periodic_fuzzy_delay = 60 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] periodic_interval = 60 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] public_endpoint = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] publish_errors = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] quota_backup_gigabytes = 1000 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] quota_backups = 10 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] quota_gigabytes = 1000 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] quota_groups = 10 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] quota_snapshots = 10 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] quota_volumes = 10 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] rate_limit_burst = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] rate_limit_except_level = CRITICAL {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] rate_limit_interval = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] reinit_driver_count = 3 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] replication_device = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] report_discard_supported = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] report_interval = 120 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] reservation_clean_interval = 86400 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] reservation_expire = 86400 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] reserved_image_namespaces = [] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] reserved_percentage = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] rpc_response_timeout = 120 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] run_external_periodic_tasks = True {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] scst_target_driver = iscsi {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] scst_target_iqn_name = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] service_down_time = 720 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] shell_completion = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] snapshot_name_template = snapshot-%s {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] split_loggers = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] state_path = /opt/stack/data/cinder {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] storage_availability_zone = nova {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] storage_protocol = iSCSI {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] syslog_log_facility = LOG_USER {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] target_helper = lioadm {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] target_ip_address = 192.168.122.117 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] target_port = 3260 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] target_protocol = iscsi {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] target_secondary_ip_addresses = [] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] trace_flags = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] transport_url = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] until_refresh = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] use_chap_auth = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] use_default_quota_class = True {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] use_journal = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] use_json = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] use_multipath_for_image_xfer = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] use_stderr = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] use_syslog = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] verify_glance_signatures = enabled {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] volume_api_class = cinder.volume.api.API {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] volume_backend_name = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] volume_clear = zero {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] volume_clear_ionice = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] volume_clear_size = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] volume_copy_bps_limit = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] volume_dd_blocksize = 1M {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] volume_name_template = volume-%s {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] volume_service_inithost_offload = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] volume_usage_audit_period = month {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] zoning_mode = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82475) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.quobyte [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 07 06:04:59 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.quobyte [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_concurrency.disable_process_locking = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Running cmd (subprocess): mount.quobyte {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.admin_password = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.admin_token = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.admin_user = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.auth_port = 35357 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.auth_protocol = https {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.auth_section = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.auth_type = password {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.auth_uri = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.auth_version = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.cache = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.certfile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.identity_uri = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.include_service_catalog = True {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.insecure = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.interface = public {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.keyfile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.memcache_password = {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.memcache_username = {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.region_name = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.service_type = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.117/identity {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.backend = dogpile.cache.null {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.backend_argument = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.backend_expiration_time = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.config_prefix = cache.oslo {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.debug_cache_backend = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.enable_retry_client = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.enable_socket_keepalive = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.enabled = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.enforce_fips_mode = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.expiration_time = 600 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.hashclient_retry_attempts = 2 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.memcache_dead_retry = 300 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.memcache_pool_maxsize = 10 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.memcache_sasl_enabled = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.password = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.proxies = [] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.redis_db = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.redis_server = localhost:6379 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.retry_attempts = 2 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.retry_delay = 0.0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.socket_keepalive_count = 1 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.socket_keepalive_idle = 1 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.socket_keepalive_interval = 1 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.socket_timeout = 1.0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.tls_allowed_ciphers = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.tls_cafile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.tls_certfile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.tls_enabled = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.tls_keyfile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cache.username = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] coordination.backend_url = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.asyncio_connection = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.asyncio_slave_connection = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.backend = sqlalchemy {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.connection = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.connection_debug = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.connection_parameters = {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.connection_recycle_time = 3600 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.connection_trace = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.db_inc_retry_interval = True {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.db_max_retries = 20 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.db_max_retry_interval = 10 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.db_retry_interval = 1 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.max_overflow = 50 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.max_pool_size = 5 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.max_retries = 10 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.mysql_wsrep_sync_wait = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.pool_timeout = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.retry_interval = 10 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.slave_connection = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.sqlite_synchronous = True {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.synchronous_reader = True {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] database.use_db_reconnect = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] profiler.connection_string = messaging:// {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] profiler.enabled = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] profiler.es_doc_type = notification {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] profiler.es_scroll_size = 10000 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] profiler.es_scroll_time = 2m {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] profiler.filter_error_trace = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] profiler.hmac_keys = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] profiler.sentinel_service_name = mymaster {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] profiler.socket_timeout = 0.1 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] profiler.trace_requests = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] profiler.trace_sqlalchemy = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] profiler_jaeger.process_tags = {} {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] profiler_jaeger.service_name_prefix = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] profiler_otlp.service_name_prefix = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_policy.enforce_new_defaults = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: WARNING oslo_config.cfg [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_policy.enforce_scope = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_policy.policy_default_rule = default {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_policy.policy_file = policy.yaml {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] privsep_osbrick.group = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] privsep_osbrick.helper_command = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] privsep_osbrick.user = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cinder_sys_admin.group = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cinder_sys_admin.helper_command = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] cinder_sys_admin.user = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] service_user.auth_section = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] service_user.auth_type = password {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] service_user.cafile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] service_user.certfile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] service_user.collect_timing = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] service_user.insecure = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] service_user.keyfile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] service_user.send_service_user_token = True {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] service_user.split_loggers = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] service_user.timeout = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack quobyte-client[82486]: Reading configuration file: /etc/quobyte/client.cfg Apr 07 06:04:59 devstack quobyte-client[82486]: Invalid parameters found, error: missing mount point. Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance.auth_section = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack quobyte-client[82486]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 07 06:04:59 devstack quobyte-client[82486]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance.auth_type = password {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance.certfile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance.collect_timing = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance.insecure = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance.keyfile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance.region_name = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] CMD "mount.quobyte" returned: 1 in 0.059s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance.split_loggers = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] glance.timeout = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.backend_availability_zone = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.chap_password = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.chap_username = {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.disk_geometry = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.driver_client_cert = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.driver_client_cert_key = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.driver_data_namespace = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.driver_use_ssl = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.extra_capabilities = {} {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.filter_function = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.goodness_function = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.iscsi_target_flags = {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.iscsi_write_cache = on {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.iser_helper = tgtadm {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.iser_ip_address = 192.168.122.117 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.iser_port = 3260 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.nas_host = {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.nas_login = admin {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.nas_mount_options = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.nas_password = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.nas_private_key = {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.nas_share_path = {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.num_shell_tries = 3 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.quobyte_volume_url = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.replication_device = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.report_discard_supported = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.reserved_percentage = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.target_helper = tgtadm {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.target_ip_address = 192.168.122.117 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.target_port = 3260 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.target_protocol = iscsi {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack sudo[82487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.trace_flags = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.unique_fqdn_network = True {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack sudo[82487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.use_chap_auth = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.volume_backend_name = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.volume_clear = zero {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.volume_clear_ionice = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.volume_clear_size = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_reports.file_event_handler = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_reports.log_dir = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.backend_availability_zone = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.backend_host = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.chap_password = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.chap_username = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.chiscsi_conf = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.disk_geometry = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.driver_client_cert = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.driver_data_namespace = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.driver_use_ssl = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.extra_capabilities = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.filter_function = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.goodness_function = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.iser_helper = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.iser_ip_address = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.iser_port = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.iser_target_prefix = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.nas_host = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.nas_login = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.nas_mount_options = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.nas_password = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.nas_private_key = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.nas_share_path = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.nas_ssh_port = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.num_shell_tries = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.nvmet_port_id = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.replication_device = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.report_discard_supported = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.reserved_percentage = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.scst_target_driver = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.storage_protocol = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.target_helper = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.target_ip_address = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.target_port = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.target_prefix = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.target_protocol = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.trace_flags = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.use_chap_auth = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.volume_clear = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.volume_clear_size = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] QuobyteHD.volumes_dir = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.ssl = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_notifications.driver = [] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_notifications.retry = -1 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] key_manager.fixed_key = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican.barbican_api_version = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican.barbican_endpoint = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican.barbican_endpoint_type = public {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican.barbican_region_name = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican.cafile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican.certfile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican.collect_timing = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican.insecure = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican.keyfile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican.number_of_retries = 60 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican.retry_delay = 1 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican.send_service_user_token = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican.split_loggers = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican.timeout = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican.verify_ssl = True {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican.verify_ssl_path = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican_service_user.auth_section = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican_service_user.auth_type = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican_service_user.cafile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican_service_user.certfile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican_service_user.collect_timing = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican_service_user.insecure = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican_service_user.keyfile = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican_service_user.split_loggers = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] barbican_service_user.timeout = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] vault.approle_role_id = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] vault.approle_secret_id = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] vault.kv_mountpoint = secret {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] vault.kv_path = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] vault.kv_version = 2 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] vault.namespace = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] vault.root_token_id = **** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] vault.ssl_ca_crt_file = None {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] vault.timeout = 60.0 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] vault.use_ssl = False {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 07 06:04:59 devstack cinder-volume[82264]: DEBUG oslo_service.backend._eventlet.service [None req-4084ea61-b902-4148-aa4b-13dbc3cc4941 None None] ******************************************************************************** {{(pid=82264) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 07 06:04:59 devstack sudo[82487]: pam_unix(sudo:session): session closed for user root Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.420s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:04:59 devstack cinder-volume[82475]: INFO cinder.volume.driver [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Driver hasn't implemented _init_vendor_properties() Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG cinder.volume.driver [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.701759338379, 'free_capacity_gb': 1775.701759338379, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82475) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG oslo_db.sqlalchemy.engines [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82475) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writer thread running {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG cinder.db.sqlalchemy.api [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Building query based on filter {{(pid=82475) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82475) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:04:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:04:59 devstack cinder-volume[82475]: INFO cinder.keymgr.migration [None req-78eab7f1-d723-458b-8eff-f55a879f0892 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 07 06:04:59 devstack sudo[82504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:04:59 devstack sudo[82504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:05:00 devstack sudo[82504]: pam_unix(sudo:session): session closed for user root Apr 07 06:05:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.448s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:05:00 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:05:00 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Driver initialization completed successfully. Apr 07 06:05:00 devstack cinder-volume[82475]: INFO cinder.manager [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Initiating service 3 cleanup Apr 07 06:05:00 devstack cinder-volume[82475]: INFO cinder.manager [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Service 3 cleanup completed. Apr 07 06:05:00 devstack cinder-volume[82475]: DEBUG cinder.service [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Creating RPC server for service cinder-volume {{(pid=82475) start /opt/stack/cinder/cinder/service.py:231}} Apr 07 06:05:00 devstack cinder-volume[82475]: DEBUG cinder.service [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82475) start /opt/stack/cinder/cinder/service.py:237}} Apr 07 06:05:00 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 07 06:05:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:05:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:05:00 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:05:00 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:05:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:05:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:05:00 devstack sudo[82508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:05:00 devstack sudo[82508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:05:00 devstack sudo[82508]: pam_unix(sudo:session): session closed for user root Apr 07 06:05:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.483s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:05:00 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-9eea365c-f6b0-4568-a1ac-4f59db8b6c55 None None] Driver post RPC initialization completed successfully. Apr 07 06:05:09 devstack cinder-volume[82264]: DEBUG dbcounter [-] [82264] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82264) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:05:10 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:SELECT=2 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:05:10 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Flow 'volume_create_manager' (6c82d7fc-170f-457f-9bc6-a729e6a97fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13de5086-4da5-4598-8d35-df0c8ace81f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13de5086-4da5-4598-8d35-df0c8ace81f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2048567082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f7173b-b7e6-463b-837f-1b57a55d6192,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='97c1431357b546e98da2ef1226111f96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:06:00Z,use_quota=True,user_id='83217100c2cc42e68db62f503d028d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c4b87c-0575-4e60-a782-0675034cd78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c4b87c-0575-4e60-a782-0675034cd78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d084ee80-8821-4a97-920d-6a72994ffed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d084ee80-8821-4a97-920d-6a72994ffed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87f7173b-b7e6-463b-837f-1b57a55d6192', 'volume_name': 'volume-87f7173b-b7e6-463b-837f-1b57a55d6192', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78bc0a2-5cff-495f-b642-dd9a9d6303b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78bc0a2-5cff-495f-b642-dd9a9d6303b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb22988-19a5-41cc-aa5b-7f7808cb6aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:00 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Volume 87f7173b-b7e6-463b-837f-1b57a55d6192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87f7173b-b7e6-463b-837f-1b57a55d6192', 'volume_size': 1} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2048567082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f7173b-b7e6-463b-837f-1b57a55d6192,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='97c1431357b546e98da2ef1226111f96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:06:00Z,use_quota=True,user_id='83217100c2cc42e68db62f503d028d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Creating volume 87f7173b-b7e6-463b-837f-1b57a55d6192 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:06:00 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:06:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-87f7173b-b7e6-463b-837f-1b57a55d6192 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:00 devstack sudo[83061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-87f7173b-b7e6-463b-837f-1b57a55d6192 1073741824 Apr 07 06:06:00 devstack sudo[83061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:01 devstack sudo[83061]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-87f7173b-b7e6-463b-837f-1b57a55d6192 1073741824" returned: 0 in 1.597s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-87f7173b-b7e6-463b-837f-1b57a55d6192 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:02 devstack sudo[83381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-87f7173b-b7e6-463b-837f-1b57a55d6192 Apr 07 06:06:02 devstack sudo[83381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:02 devstack sudo[83381]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-87f7173b-b7e6-463b-837f-1b57a55d6192" returned: 0 in 0.750s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] <== create_volume: return (2489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:06:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.492s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:02 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb22988-19a5-41cc-aa5b-7f7808cb6aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f7173b-b7e6-463b-837f-1b57a55d6192', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:02 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f331d8ce-04f6-4521-93e5-972d03db2940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:02 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Volume volume-87f7173b-b7e6-463b-837f-1b57a55d6192 (87f7173b-b7e6-463b-837f-1b57a55d6192): created successfully Apr 07 06:06:02 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f331d8ce-04f6-4521-93e5-972d03db2940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:02 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Flow 'volume_create_manager' (6c82d7fc-170f-457f-9bc6-a729e6a97fb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:06:02 devstack cinder-volume[82475]: INFO cinder.volume.manager [req-8b8ef0ad-de18-47c5-9779-e82cf285046b req-f9ba6664-d6a6-45f2-86e1-2ad3a2db6ed0 tempest-VolumesGetTestJSON-1730274331 None] Created volume successfully. Apr 07 06:06:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Acquiring lock "cinder-87f7173b-b7e6-463b-837f-1b57a55d6192-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:06:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Lock "cinder-87f7173b-b7e6-463b-837f-1b57a55d6192-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:06:05 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Acquiring lock "cinder-quobyte-87f7173b-b7e6-463b-837f-1b57a55d6192" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:06:05 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Lock "cinder-quobyte-87f7173b-b7e6-463b-837f-1b57a55d6192" acquired by "delete_volume" :: waited 0.025s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:06:05 devstack cinder-volume[82475]: INFO oslo.privsep.daemon [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4253r71p/privsep.sock'] Apr 07 06:06:05 devstack sudo[83421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4253r71p/privsep.sock Apr 07 06:06:05 devstack sudo[83421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Flow 'volume_create_manager' (0c4ebbc2-7c2a-4080-9dc5-e5d0317ae20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5223a54-07a8-4517-adc2-ecd73e6bdf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5223a54-07a8-4517-adc2-ecd73e6bdf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-496080756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77401cf3-f638-473d-83f8-79156585cc34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd749cba2b074783be35a6feeedb3bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:06:07Z,use_quota=True,user_id='91bc3773202a4a9b92800d9b6e1c0638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fccc388a-f89b-4acf-80e3-188b01c1e37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fccc388a-f89b-4acf-80e3-188b01c1e37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf024dc-1db4-461e-a263-e09179f88adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf024dc-1db4-461e-a263-e09179f88adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77401cf3-f638-473d-83f8-79156585cc34', 'volume_name': 'volume-77401cf3-f638-473d-83f8-79156585cc34', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad10d11b-9458-497a-a4d9-f69e7152c7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad10d11b-9458-497a-a4d9-f69e7152c7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7efd60a-3e36-409c-9499-043e483b5ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:07 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Volume 77401cf3-f638-473d-83f8-79156585cc34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77401cf3-f638-473d-83f8-79156585cc34', 'volume_size': 1} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-496080756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77401cf3-f638-473d-83f8-79156585cc34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd749cba2b074783be35a6feeedb3bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:06:07Z,use_quota=True,user_id='91bc3773202a4a9b92800d9b6e1c0638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Creating volume 77401cf3-f638-473d-83f8-79156585cc34 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:06:07 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-77401cf3-f638-473d-83f8-79156585cc34 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:07 devstack sudo[83433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-77401cf3-f638-473d-83f8-79156585cc34 1073741824 Apr 07 06:06:07 devstack sudo[83433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:07 devstack sudo[83421]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:07 devstack cinder-volume[82475]: INFO oslo.privsep.daemon [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Spawned new privsep daemon via rootwrap Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Accepted privsep connection to /tmp/tmp4253r71p/privsep.sock {{(pid=82475) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 07 06:06:07 devstack cinder-volume[82475]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 07 06:06:07 devstack cinder-volume[82475]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 07 06:06:07 devstack cinder-volume[82475]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 07 06:06:07 devstack cinder-volume[82475]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83432 Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c59bae-0a21-432c-97ee-b26f6094514d]: (2,) {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b1c512-0d9f-4ca8-b9cb-9ccc2408a07b]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-87f7173b-b7e6-463b-837f-1b57a55d6192 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:07 devstack sudo[83436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-87f7173b-b7e6-463b-837f-1b57a55d6192 Apr 07 06:06:07 devstack sudo[83436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:08 devstack sudo[83433]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-77401cf3-f638-473d-83f8-79156585cc34 1073741824" returned: 0 in 1.413s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-77401cf3-f638-473d-83f8-79156585cc34 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:08 devstack sudo[83448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-77401cf3-f638-473d-83f8-79156585cc34 Apr 07 06:06:08 devstack sudo[83448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:09 devstack sudo[83436]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-87f7173b-b7e6-463b-837f-1b57a55d6192" returned: 0 in 1.469s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-87f7173b-b7e6-463b-837f-1b57a55d6192 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:09 devstack sudo[83450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-87f7173b-b7e6-463b-837f-1b57a55d6192 Apr 07 06:06:09 devstack sudo[83450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:09 devstack sudo[83450]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-87f7173b-b7e6-463b-837f-1b57a55d6192" returned: 0 in 0.702s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Lock "cinder-quobyte-87f7173b-b7e6-463b-837f-1b57a55d6192" released by "delete_volume" :: held 4.704s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:06:09 devstack cinder-volume[82475]: WARNING cinder.quota [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:06:09 devstack cinder-volume[82475]: WARNING cinder.quota [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:06:09 devstack cinder-volume[82475]: DEBUG cinder.quota [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Created reservations ['51bf2033-0a98-43de-9e3c-0c59b8fe983d', 'd682caee-ce85-4ad8-bca0-d18119ad48e5', 'f9debaba-38b7-4cb5-ac7c-dd8034fd08c4', 'b84ae085-9728-4270-a884-59e08d00c5c5'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:06:09 devstack sudo[83448]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-77401cf3-f638-473d-83f8-79156585cc34" returned: 0 in 1.291s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] <== create_volume: return (2762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:06:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.768s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:06:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:06:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7efd60a-3e36-409c-9499-043e483b5ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77401cf3-f638-473d-83f8-79156585cc34', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:10 devstack sudo[83457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:06:10 devstack sudo[83457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c410d9b-3491-497a-bf29-52322100f566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:10 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Volume volume-77401cf3-f638-473d-83f8-79156585cc34 (77401cf3-f638-473d-83f8-79156585cc34): created successfully Apr 07 06:06:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c410d9b-3491-497a-bf29-52322100f566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Flow 'volume_create_manager' (0c4ebbc2-7c2a-4080-9dc5-e5d0317ae20d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:06:10 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-05626271-e4b4-4560-b214-b3128c6b19e7 tempest-ServerRescueNegativeTestJSON-40372772 None] Created volume successfully. Apr 07 06:06:11 devstack sudo[83457]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 1.519s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:11 devstack cinder-volume[82475]: DEBUG cinder.manager [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:06:11 devstack cinder-volume[82475]: INFO cinder.volume.manager [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Deleted volume successfully. Apr 07 06:06:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-25b361cf-2be8-4499-91ee-605db6f56c47 req-510a9edc-5a12-41b7-adb7-e0e0410273ec tempest-VolumesGetTestJSON-1730274331 None] Lock "cinder-87f7173b-b7e6-463b-837f-1b57a55d6192-delete_volume" released by "delete_volume" :: held 6.703s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Flow 'volume_create_manager' (6bf6f899-4d34-47e4-b6c5-3badb16de906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f121d1d-d0e9-460c-ad0e-54d2ca83547d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f121d1d-d0e9-460c-ad0e-54d2ca83547d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:06:14Z,deleted=False,deleted_at=None,display_description='',display_name='60fee42d-ca4d-4c26-97a5-a4f040cb96b3-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9976ab6-de46-47dc-a371-bc9b746d2f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34703ed4f2744f2d87025ae2e6bd2b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:06:14Z,use_quota=True,user_id='f930f64cc2c341abaff51446966a1fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2afe3b-0bee-411f-9433-76c5b83a606d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2afe3b-0bee-411f-9433-76c5b83a606d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9125378-b431-48f6-9e11-919f755d8865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9125378-b431-48f6-9e11-919f755d8865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9976ab6-de46-47dc-a371-bc9b746d2f81', 'volume_name': 'volume-d9976ab6-de46-47dc-a371-bc9b746d2f81', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59cff573-ae62-4010-a5cc-4b161714fab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59cff573-ae62-4010-a5cc-4b161714fab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cd42bd-35ee-4962-a72d-b18aa14cbf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:14 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Volume d9976ab6-de46-47dc-a371-bc9b746d2f81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9976ab6-de46-47dc-a371-bc9b746d2f81', 'volume_size': 1} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:06:14Z,deleted=False,deleted_at=None,display_description='',display_name='60fee42d-ca4d-4c26-97a5-a4f040cb96b3-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9976ab6-de46-47dc-a371-bc9b746d2f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34703ed4f2744f2d87025ae2e6bd2b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:06:14Z,use_quota=True,user_id='f930f64cc2c341abaff51446966a1fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Creating volume d9976ab6-de46-47dc-a371-bc9b746d2f81 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:06:14 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:06:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d9976ab6-de46-47dc-a371-bc9b746d2f81 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:14 devstack sudo[83495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d9976ab6-de46-47dc-a371-bc9b746d2f81 1073741824 Apr 07 06:06:14 devstack sudo[83495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:16 devstack sudo[83495]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d9976ab6-de46-47dc-a371-bc9b746d2f81 1073741824" returned: 0 in 1.492s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d9976ab6-de46-47dc-a371-bc9b746d2f81 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:16 devstack sudo[83509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d9976ab6-de46-47dc-a371-bc9b746d2f81 Apr 07 06:06:16 devstack sudo[83509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:17 devstack sudo[83509]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d9976ab6-de46-47dc-a371-bc9b746d2f81" returned: 0 in 1.150s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] <== create_volume: return (2764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:06:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.767s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:17 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cd42bd-35ee-4962-a72d-b18aa14cbf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9976ab6-de46-47dc-a371-bc9b746d2f81', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:17 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb6479c-8bbf-4df6-b7b9-9afdf60c1980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:17 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Volume volume-d9976ab6-de46-47dc-a371-bc9b746d2f81 (d9976ab6-de46-47dc-a371-bc9b746d2f81): created successfully Apr 07 06:06:17 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb6479c-8bbf-4df6-b7b9-9afdf60c1980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:17 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Flow 'volume_create_manager' (6bf6f899-4d34-47e4-b6c5-3badb16de906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:06:17 devstack cinder-volume[82475]: INFO cinder.volume.manager [req-3a397437-2058-4865-99a3-985f77829235 req-7ae102a6-146a-4217-a7e9-b75385c80b89 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Created volume successfully. Apr 07 06:06:24 devstack cinder-volume[82475]: WARNING py.warnings [req-3a397437-2058-4865-99a3-985f77829235 req-61f417b5-ae19-43b6-ba1b-8455845c83bd tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 07 06:06:24 devstack cinder-volume[82475]: .first() Apr 07 06:06:24 devstack cinder-volume[82475]: Apr 07 06:06:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-3a397437-2058-4865-99a3-985f77829235 req-61f417b5-ae19-43b6-ba1b-8455845c83bd tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-3a397437-2058-4865-99a3-985f77829235 req-61f417b5-ae19-43b6-ba1b-8455845c83bd tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:24 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cde85a-2996-4315-8c48-ee63d5758a15]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-3a397437-2058-4865-99a3-985f77829235 req-61f417b5-ae19-43b6-ba1b-8455845c83bd tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d9976ab6-de46-47dc-a371-bc9b746d2f81 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:24 devstack sudo[83588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d9976ab6-de46-47dc-a371-bc9b746d2f81 Apr 07 06:06:24 devstack sudo[83588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:25 devstack sudo[83588]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-3a397437-2058-4865-99a3-985f77829235 req-61f417b5-ae19-43b6-ba1b-8455845c83bd tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d9976ab6-de46-47dc-a371-bc9b746d2f81" returned: 0 in 0.859s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-3a397437-2058-4865-99a3-985f77829235 req-61f417b5-ae19-43b6-ba1b-8455845c83bd tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.884s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-3a397437-2058-4865-99a3-985f77829235 req-61f417b5-ae19-43b6-ba1b-8455845c83bd tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7', 'name': 'volume-d9976ab6-de46-47dc-a371-bc9b746d2f81', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbc37d8c-e4ba-4bcd-81ba-cf7007964721', 'enforce_multipath': True} {{(pid=82475) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 07 06:06:25 devstack cinder-volume[82475]: INFO cinder.volume.manager [req-3a397437-2058-4865-99a3-985f77829235 req-61f417b5-ae19-43b6-ba1b-8455845c83bd tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] attachment_update completed successfully. Apr 07 06:06:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3938cf5e-d07b-4eb7-a362-04d4988495bd tempest-BackendsCapabilitiesAdminTestsJSON-1439143245 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.701759338379, 'free_capacity_gb': 1775.701759338379, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82475) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 07 06:06:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d257730-7791-48ae-9441-4d335df90e35 tempest-BackendsCapabilitiesAdminTestsJSON-1439143245 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.701759338379, 'free_capacity_gb': 1775.701759338379, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82475) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 07 06:06:35 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:SELECT=19,cinder:UPDATE=22,cinder:DELETE=3,cinder:INSERT=5 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:06:35 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:SELECT=14,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:06:36 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-0f3ba1ba-0f55-4fa7-be80-7ab8dba3e130 tempest-GroupsV314Test-1187390145 None] Group tempest-GroupsV314Test-Group-1896636250: creating Apr 07 06:06:36 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-0f3ba1ba-0f55-4fa7-be80-7ab8dba3e130 tempest-GroupsV314Test-1187390145 None] Group tempest-GroupsV314Test-Group-1896636250: created successfully Apr 07 06:06:36 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-0f3ba1ba-0f55-4fa7-be80-7ab8dba3e130 tempest-GroupsV314Test-1187390145 None] Create group completed successfully. Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Flow 'volume_create_manager' (21deb627-dc5c-4504-a663-be7f83c01420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6828c5-7899-4063-bfe9-e1a5076e6f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6828c5-7899-4063-bfe9-e1a5076e6f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-684228168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d648dde-e3cd-49b5-9d48-56d0a455cf9d,host='devstack@QuobyteHD#QuobyteHD',id=4a10a477-2f69-4fd9-9bce-93dfcf28ea46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c65b787db34050a1b2fd0bf2a98350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:06:38Z,use_quota=True,user_id='ddccc18d2ca7495988a4347a232fa3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e962e1bd-7cbe-4ef1-8e55-7565e74619c8),volume_type_id=e962e1bd-7cbe-4ef1-8e55-7565e74619c8)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec3bab8-d0a4-403a-999e-e97e3cd1883d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec3bab8-d0a4-403a-999e-e97e3cd1883d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d337f7c-3e95-415a-afb7-0315fd592c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d337f7c-3e95-415a-afb7-0315fd592c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a10a477-2f69-4fd9-9bce-93dfcf28ea46', 'volume_name': 'volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9611b0ab-ec72-40dc-9419-2fad4683bd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9611b0ab-ec72-40dc-9419-2fad4683bd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae91ffc-4180-4d1d-bfd0-78a505b1f3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:38 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Volume 4a10a477-2f69-4fd9-9bce-93dfcf28ea46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46', 'volume_size': 1} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3d648dde-e3cd-49b5-9d48-56d0a455cf9d,created_at=2026-04-07T04:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-684228168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d648dde-e3cd-49b5-9d48-56d0a455cf9d,host='devstack@QuobyteHD#QuobyteHD',id=4a10a477-2f69-4fd9-9bce-93dfcf28ea46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c65b787db34050a1b2fd0bf2a98350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:06:38Z,use_quota=True,user_id='ddccc18d2ca7495988a4347a232fa3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e962e1bd-7cbe-4ef1-8e55-7565e74619c8),volume_type_id=e962e1bd-7cbe-4ef1-8e55-7565e74619c8)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Creating volume 4a10a477-2f69-4fd9-9bce-93dfcf28ea46 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:06:38 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:06:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:38 devstack sudo[84101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 1073741824 Apr 07 06:06:38 devstack sudo[84101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:39 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] Acquiring lock "cinder-77401cf3-f638-473d-83f8-79156585cc34-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:06:39 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] Lock "cinder-77401cf3-f638-473d-83f8-79156585cc34-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:06:39 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] Acquiring lock "cinder-quobyte-77401cf3-f638-473d-83f8-79156585cc34" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:06:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] Lock "cinder-quobyte-77401cf3-f638-473d-83f8-79156585cc34" acquired by "delete_volume" :: waited 0.031s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:06:40 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4715d4-d14b-4793-ae02-619c51560d50]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-77401cf3-f638-473d-83f8-79156585cc34 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:40 devstack sudo[84111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-77401cf3-f638-473d-83f8-79156585cc34 Apr 07 06:06:40 devstack sudo[84111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:40 devstack sudo[84101]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 1073741824" returned: 0 in 1.721s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:40 devstack sudo[84113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 Apr 07 06:06:40 devstack sudo[84113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:41 devstack sudo[84111]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-77401cf3-f638-473d-83f8-79156585cc34" returned: 0 in 1.457s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-77401cf3-f638-473d-83f8-79156585cc34 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:41 devstack sudo[84113]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46" returned: 0 in 1.226s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] <== create_volume: return (3025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:06:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.032s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:41 devstack sudo[84120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-77401cf3-f638-473d-83f8-79156585cc34 Apr 07 06:06:41 devstack sudo[84120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae91ffc-4180-4d1d-bfd0-78a505b1f3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa50d17-0b58-473e-a536-35a8ac9bed30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:06:41 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Volume volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 (4a10a477-2f69-4fd9-9bce-93dfcf28ea46): created successfully Apr 07 06:06:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa50d17-0b58-473e-a536-35a8ac9bed30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:06:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Flow 'volume_create_manager' (21deb627-dc5c-4504-a663-be7f83c01420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:06:41 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-c292006c-a1aa-419e-8ce8-ea9ed5670e5b tempest-GroupsV314Test-1187390145 None] Created volume successfully. Apr 07 06:06:42 devstack sudo[84120]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-77401cf3-f638-473d-83f8-79156585cc34" returned: 0 in 1.073s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:42 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] Lock "cinder-quobyte-77401cf3-f638-473d-83f8-79156585cc34" released by "delete_volume" :: held 2.664s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:06:42 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] Created reservations ['261c4914-96c9-43d9-8321-66603296b54d', '3c58f284-c159-4e9d-9dc2-5b212042b3e1', '7bf75803-6b0f-45c0-83ac-9099ca177b7c', '98b0f450-5ef5-4b0b-b9f7-6960d424cea1'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:06:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:06:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:06:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:42 devstack sudo[84124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:06:42 devstack sudo[84124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:43 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Cloning volume 4a10a477-2f69-4fd9-9bce-93dfcf28ea46 to volume 427dae7a-fcba-4eec-8922-33e5a42bfc2b Apr 07 06:06:43 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Creating offline snapshot 381599bc-4089-4444-9670-20c15fe81b4d of volume 4a10a477-2f69-4fd9-9bce-93dfcf28ea46 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:06:43 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81c11bb-6382-4399-804a-6a947741e70d]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:44 devstack sudo[84124]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 1.184s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:44 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:06:44 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] Deleted volume successfully. Apr 07 06:06:44 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-6b3f22af-5555-4226-9d19-7dd01d53d447 tempest-ServerRescueNegativeTestJSON-40372772 None] Lock "cinder-77401cf3-f638-473d-83f8-79156585cc34-delete_volume" released by "delete_volume" :: held 4.177s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:06:44 devstack sudo[84130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 Apr 07 06:06:44 devstack sudo[84130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:45 devstack sudo[84130]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46" returned: 0 in 1.192s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:45 devstack sudo[84210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d 1G Apr 07 06:06:45 devstack sudo[84210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:46 devstack sudo[84210]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d 1G" returned: 0 in 0.869s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:46 devstack sudo[84222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d Apr 07 06:06:46 devstack sudo[84222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:47 devstack sudo[84222]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d" returned: 0 in 1.257s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:47 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:06:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:47 devstack sudo[84247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d Apr 07 06:06:47 devstack sudo[84247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:47 devstack sudo[84247]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d" returned: 0 in 0.594s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:47 devstack sudo[84250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.info Apr 07 06:06:47 devstack sudo[84250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:48 devstack sudo[84250]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.info" returned: 0 in 0.967s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:48 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.info is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:06:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:48 devstack sudo[84279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.info Apr 07 06:06:48 devstack sudo[84279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:49 devstack sudo[84279]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.info" returned: 0 in 0.517s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:49 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Acquiring lock "cinder-quobyte-427dae7a-fcba-4eec-8922-33e5a42bfc2b" by "_copy_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:06:49 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Lock "cinder-quobyte-427dae7a-fcba-4eec-8922-33e5a42bfc2b" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:06:49 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] snapshot: 381599bc-4089-4444-9670-20c15fe81b4d, volume: 427dae7a-fcba-4eec-8922-33e5a42bfc2b, {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:06:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:49 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:06:49 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:06:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:49 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[0778b702-fe41-4d94-b99e-69131b4fb535]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:49 devstack sudo[84282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d Apr 07 06:06:49 devstack sudo[84282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:50 devstack sudo[84282]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d" returned: 0 in 0.886s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:50 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:06:50 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] will copy from snapshot at /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:06:50 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Creating direct copy from snapshot {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:06:50 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b6852c-f4fe-4428-b8b8-67b834c88fd6]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:50 devstack sudo[84289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 Apr 07 06:06:50 devstack sudo[84289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:51 devstack sudo[84289]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46" returned: 0 in 0.909s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:51 devstack cinder-volume[82475]: DEBUG cinder.utils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Path /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-427dae7a-fcba-4eec-8922-33e5a42bfc2b not found in is_blk_device check {{(pid=82475) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:06:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-427dae7a-fcba-4eec-8922-33e5a42bfc2b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:51 devstack sudo[84300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-427dae7a-fcba-4eec-8922-33e5a42bfc2b Apr 07 06:06:51 devstack sudo[84300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:51 devstack cinder-volume[82475]: DEBUG oslo_service.periodic_task [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82475) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:06:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:06:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:06:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:06:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:06:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:06:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:51 devstack sudo[84334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:06:51 devstack sudo[84334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:54 devstack sudo[84334]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 2.842s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:54 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:06:55 devstack sudo[84300]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-427dae7a-fcba-4eec-8922-33e5a42bfc2b" returned: 0 in 4.649s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:55 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[1030fa54-c9af-4745-a466-96960ca7aa64]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:56 devstack sudo[84378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 Apr 07 06:06:56 devstack sudo[84378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:57 devstack sudo[84378]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46" returned: 0 in 1.089s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:57 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Image conversion details: src /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46, size 1024.00 MB, duration 4.65 sec, destination /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-427dae7a-fcba-4eec-8922-33e5a42bfc2b {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:06:57 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Converted 1024.00 MB image at 220.19 MB/s Apr 07 06:06:57 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-427dae7a-fcba-4eec-8922-33e5a42bfc2b is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:06:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-427dae7a-fcba-4eec-8922-33e5a42bfc2b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:57 devstack sudo[84387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-427dae7a-fcba-4eec-8922-33e5a42bfc2b Apr 07 06:06:57 devstack sudo[84387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:57 devstack sudo[84387]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:57 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:SELECT=14,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:06:57 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:SELECT=14,cinder:UPDATE=16,cinder:DELETE=2,cinder:INSERT=6 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:06:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-427dae7a-fcba-4eec-8922-33e5a42bfc2b" returned: 0 in 0.864s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Lock "cinder-quobyte-427dae7a-fcba-4eec-8922-33e5a42bfc2b" released by "_copy_volume_from_snapshot" :: held 8.507s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:06:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Acquiring lock "cinder-quobyte-381599bc-4089-4444-9670-20c15fe81b4d" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:06:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Lock "cinder-quobyte-381599bc-4089-4444-9670-20c15fe81b4d" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:06:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Deleting offline snapshot 381599bc-4089-4444-9670-20c15fe81b4d of volume 4a10a477-2f69-4fd9-9bce-93dfcf28ea46 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:06:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] snapshot_file for this snap is: volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:06:58 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3c843b-ab90-4061-a33e-df3238379ded]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:58 devstack sudo[84391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d Apr 07 06:06:58 devstack sudo[84391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:58 devstack sudo[84391]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d" returned: 0 in 0.678s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:58 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:06:58 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20969d1-4564-4d60-9670-312df2d52d9a]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:06:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:58 devstack sudo[84396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 Apr 07 06:06:58 devstack sudo[84396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:06:59 devstack sudo[84396]: pam_unix(sudo:session): session closed for user root Apr 07 06:06:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46" returned: 0 in 0.909s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:06:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:06:59 devstack sudo[84403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d Apr 07 06:06:59 devstack sudo[84403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:00 devstack sudo[84403]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d" returned: 0 in 0.741s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:00 devstack sudo[84431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d Apr 07 06:07:00 devstack sudo[84431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:01 devstack sudo[84431]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46.381599bc-4089-4444-9670-20c15fe81b4d" returned: 0 in 0.909s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Lock "cinder-quobyte-381599bc-4089-4444-9670-20c15fe81b4d" released by "_delete_snapshot" :: held 3.348s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.446s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:01 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-a4672e27-7393-4134-8486-5fa87e465e37 tempest-GroupsV314Test-1187390145 None] Create group from source-group-3d648dde-e3cd-49b5-9d48-56d0a455cf9d completed successfully. Apr 07 06:07:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] Acquiring lock "cinder-quobyte-427dae7a-fcba-4eec-8922-33e5a42bfc2b" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] Lock "cinder-quobyte-427dae7a-fcba-4eec-8922-33e5a42bfc2b" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:02 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2979dc-1a9c-4b65-88da-684427082071]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-427dae7a-fcba-4eec-8922-33e5a42bfc2b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:02 devstack sudo[84461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-427dae7a-fcba-4eec-8922-33e5a42bfc2b Apr 07 06:07:02 devstack sudo[84461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:02 devstack sudo[84461]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-427dae7a-fcba-4eec-8922-33e5a42bfc2b" returned: 0 in 0.737s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-427dae7a-fcba-4eec-8922-33e5a42bfc2b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:02 devstack sudo[84467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-427dae7a-fcba-4eec-8922-33e5a42bfc2b Apr 07 06:07:02 devstack sudo[84467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:03 devstack sudo[84467]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-427dae7a-fcba-4eec-8922-33e5a42bfc2b" returned: 0 in 0.599s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] Lock "cinder-quobyte-427dae7a-fcba-4eec-8922-33e5a42bfc2b" released by "delete_volume" :: held 1.370s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:03 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] Created reservations ['6318888b-dade-4125-9b30-a78e2282af92'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:07:03 devstack cinder-volume[82475]: WARNING cinder.quota [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1979205219 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1979205219, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:07:03 devstack cinder-volume[82475]: WARNING cinder.quota [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1979205219 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1979205219, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:07:03 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] Created reservations ['51492ad5-aa24-4d4b-a254-1224e654f40f', 'c06e897b-951f-49fc-b705-945f82359657', 'cf082b88-e260-4975-8b16-790b690cc8a8', 'a328a486-da40-44b4-ae21-211e5b7f19b0'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:07:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:07:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:07:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:03 devstack sudo[84474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:07:03 devstack sudo[84474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:04 devstack sudo[84474]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.621s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:04 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:07:04 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-8fc31790-11e9-42f6-b6b1-e35b20d50bf9 tempest-GroupsV314Test-1187390145 None] Delete group completed successfully. Apr 07 06:07:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e5432535-c24a-4c92-9754-1a3a652592d1 tempest-GroupsV314Test-1187390145 None] Acquiring lock "cinder-quobyte-4a10a477-2f69-4fd9-9bce-93dfcf28ea46" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e5432535-c24a-4c92-9754-1a3a652592d1 tempest-GroupsV314Test-1187390145 None] Lock "cinder-quobyte-4a10a477-2f69-4fd9-9bce-93dfcf28ea46" acquired by "delete_volume" :: waited 0.022s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:04 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26095f5-0637-4457-ba66-8cab9b5f666b]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e5432535-c24a-4c92-9754-1a3a652592d1 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:04 devstack sudo[84487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 Apr 07 06:07:04 devstack sudo[84487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:05 devstack sudo[84487]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e5432535-c24a-4c92-9754-1a3a652592d1 tempest-GroupsV314Test-1187390145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46" returned: 0 in 0.801s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e5432535-c24a-4c92-9754-1a3a652592d1 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:05 devstack sudo[84498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46 Apr 07 06:07:05 devstack sudo[84498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:06 devstack sudo[84498]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e5432535-c24a-4c92-9754-1a3a652592d1 tempest-GroupsV314Test-1187390145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4a10a477-2f69-4fd9-9bce-93dfcf28ea46" returned: 0 in 0.743s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:06 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e5432535-c24a-4c92-9754-1a3a652592d1 tempest-GroupsV314Test-1187390145 None] Lock "cinder-quobyte-4a10a477-2f69-4fd9-9bce-93dfcf28ea46" released by "delete_volume" :: held 1.628s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:06 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-e5432535-c24a-4c92-9754-1a3a652592d1 tempest-GroupsV314Test-1187390145 None] Created reservations ['648fc1df-41c9-43c2-b286-8d5d04d6c4d6'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:07:06 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-e5432535-c24a-4c92-9754-1a3a652592d1 tempest-GroupsV314Test-1187390145 None] Created reservations ['5ce713d7-2aa3-4c3d-9a8d-b721d1d55d4e', '3840617d-1db8-46a8-9ff2-6da684d28e42', 'bc0db7ae-2efc-47ea-9720-365b5f6020ac', '66f2bd98-bd1a-4bb6-9f54-78ba6071556c'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:07:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e5432535-c24a-4c92-9754-1a3a652592d1 tempest-GroupsV314Test-1187390145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e5432535-c24a-4c92-9754-1a3a652592d1 tempest-GroupsV314Test-1187390145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:06 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e5432535-c24a-4c92-9754-1a3a652592d1 tempest-GroupsV314Test-1187390145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:07:06 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e5432535-c24a-4c92-9754-1a3a652592d1 tempest-GroupsV314Test-1187390145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:07:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e5432535-c24a-4c92-9754-1a3a652592d1 tempest-GroupsV314Test-1187390145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e5432535-c24a-4c92-9754-1a3a652592d1 tempest-GroupsV314Test-1187390145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:06 devstack sudo[84506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:07:06 devstack sudo[84506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:07 devstack sudo[84506]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e5432535-c24a-4c92-9754-1a3a652592d1 tempest-GroupsV314Test-1187390145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.850s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:07 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-e5432535-c24a-4c92-9754-1a3a652592d1 tempest-GroupsV314Test-1187390145 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:07:07 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-e5432535-c24a-4c92-9754-1a3a652592d1 tempest-GroupsV314Test-1187390145 None] Delete group completed successfully. Apr 07 06:07:16 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:UPDATE=32,cinder:SELECT=19,cinder:INSERT=9 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:07:16 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:UPDATE=18,cinder:SELECT=22,cinder:INSERT=1 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Flow 'volume_create_manager' (950ec32b-9168-4eb0-af5b-d901fbed365d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6800c5-5ae3-4bcf-b0a9-914860cbb29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6800c5-5ae3-4bcf-b0a9-914860cbb29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-318224653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d361f298-b1db-4972-9af2-7974ce8073ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29790f40e2744cdbbc86caadbd9a67b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:07:21Z,use_quota=True,user_id='026ea3ce238e4725955f205f7c3cbbd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d09130-7db1-49fe-920d-d5eb78d9b86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d09130-7db1-49fe-920d-d5eb78d9b86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf8138b-4cb7-4c0d-8357-7e32f38d51df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf8138b-4cb7-4c0d-8357-7e32f38d51df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd361f298-b1db-4972-9af2-7974ce8073ae', 'volume_name': 'volume-d361f298-b1db-4972-9af2-7974ce8073ae', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6145560-b329-40b0-97dd-95628d599807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6145560-b329-40b0-97dd-95628d599807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11521e3a-2594-42b0-b565-84489248e633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:20 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Volume d361f298-b1db-4972-9af2-7974ce8073ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d361f298-b1db-4972-9af2-7974ce8073ae', 'volume_size': 1} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-318224653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d361f298-b1db-4972-9af2-7974ce8073ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29790f40e2744cdbbc86caadbd9a67b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:07:21Z,use_quota=True,user_id='026ea3ce238e4725955f205f7c3cbbd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Creating volume d361f298-b1db-4972-9af2-7974ce8073ae {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:07:20 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:07:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d361f298-b1db-4972-9af2-7974ce8073ae 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:20 devstack sudo[84622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d361f298-b1db-4972-9af2-7974ce8073ae 1073741824 Apr 07 06:07:20 devstack sudo[84622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:22 devstack sudo[84622]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d361f298-b1db-4972-9af2-7974ce8073ae 1073741824" returned: 0 in 1.244s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d361f298-b1db-4972-9af2-7974ce8073ae {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:22 devstack sudo[84652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d361f298-b1db-4972-9af2-7974ce8073ae Apr 07 06:07:22 devstack sudo[84652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:22 devstack sudo[84652]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d361f298-b1db-4972-9af2-7974ce8073ae" returned: 0 in 0.795s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] <== create_volume: return (2117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:07:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11521e3a-2594-42b0-b565-84489248e633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d361f298-b1db-4972-9af2-7974ce8073ae', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c0588d-217a-42be-b543-e14bb5b6fda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:22 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Volume volume-d361f298-b1db-4972-9af2-7974ce8073ae (d361f298-b1db-4972-9af2-7974ce8073ae): created successfully Apr 07 06:07:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c0588d-217a-42be-b543-e14bb5b6fda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Flow 'volume_create_manager' (950ec32b-9168-4eb0-af5b-d901fbed365d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:07:22 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-e26566a2-35bf-48fa-aa59-b7e19e5e5e0e tempest-VolumesAdminNegativeTest-1066160449 None] Created volume successfully. Apr 07 06:07:24 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] Acquiring lock "cinder-d361f298-b1db-4972-9af2-7974ce8073ae-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:24 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] Lock "cinder-d361f298-b1db-4972-9af2-7974ce8073ae-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:24 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] Acquiring lock "cinder-quobyte-d361f298-b1db-4972-9af2-7974ce8073ae" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:24 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] Lock "cinder-quobyte-d361f298-b1db-4972-9af2-7974ce8073ae" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:24 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c48f00-8b56-4245-bb0c-388e6cb50705]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d361f298-b1db-4972-9af2-7974ce8073ae {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:24 devstack sudo[84661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d361f298-b1db-4972-9af2-7974ce8073ae Apr 07 06:07:24 devstack sudo[84661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:25 devstack sudo[84661]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d361f298-b1db-4972-9af2-7974ce8073ae" returned: 0 in 0.750s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d361f298-b1db-4972-9af2-7974ce8073ae {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:25 devstack sudo[84666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d361f298-b1db-4972-9af2-7974ce8073ae Apr 07 06:07:25 devstack sudo[84666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:26 devstack sudo[84666]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d361f298-b1db-4972-9af2-7974ce8073ae" returned: 0 in 0.776s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] Lock "cinder-quobyte-d361f298-b1db-4972-9af2-7974ce8073ae" released by "delete_volume" :: held 1.590s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:26 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] Created reservations ['3c912116-0489-4021-a273-9c8669916c6f', 'c1b77706-0d2c-4124-af12-9509e4b453b3', '245fd2a8-84b6-42b8-9ac5-e124dc610684', '129376bd-cf4d-408f-9bc3-b8105930d7f5'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:07:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:07:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:07:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:26 devstack sudo[84670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:07:26 devstack sudo[84670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:27 devstack sudo[84670]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 1.176s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:27 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:07:27 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] Deleted volume successfully. Apr 07 06:07:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db5e7ff0-2ba9-45df-a011-698eaac35573 tempest-VolumesAdminNegativeTest-1066160449 None] Lock "cinder-d361f298-b1db-4972-9af2-7974ce8073ae-delete_volume" released by "delete_volume" :: held 2.998s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Flow 'volume_create_manager' (86eeac56-619c-4bd9-b816-e0746944006c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f261ef-0f83-499b-997a-ad3330ca9523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f261ef-0f83-499b-997a-ad3330ca9523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-141308109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a2aff90-76bb-4a21-9304-03b3cab3010e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d49a120da2487dae11d231136fb993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:07:35Z,use_quota=True,user_id='8a1339f7aca04e43b6ae1dd2689231c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f6bcb6-d9e9-43f3-a033-07f96a4675bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f6bcb6-d9e9-43f3-a033-07f96a4675bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c30c95-2fb9-40e4-97e8-2979cf2c552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c30c95-2fb9-40e4-97e8-2979cf2c552a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a2aff90-76bb-4a21-9304-03b3cab3010e', 'volume_name': 'volume-2a2aff90-76bb-4a21-9304-03b3cab3010e', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9240d0c0-f5ac-4797-ac2e-253c9c8f5357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9240d0c0-f5ac-4797-ac2e-253c9c8f5357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80825aca-cbcf-4a5f-94e6-1b49673b2141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:35 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Volume 2a2aff90-76bb-4a21-9304-03b3cab3010e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a2aff90-76bb-4a21-9304-03b3cab3010e', 'volume_size': 1} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-141308109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a2aff90-76bb-4a21-9304-03b3cab3010e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d49a120da2487dae11d231136fb993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:07:35Z,use_quota=True,user_id='8a1339f7aca04e43b6ae1dd2689231c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Creating volume 2a2aff90-76bb-4a21-9304-03b3cab3010e {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:07:35 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:07:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2a2aff90-76bb-4a21-9304-03b3cab3010e 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:35 devstack sudo[84772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2a2aff90-76bb-4a21-9304-03b3cab3010e 1073741824 Apr 07 06:07:35 devstack sudo[84772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:36 devstack sudo[84772]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2a2aff90-76bb-4a21-9304-03b3cab3010e 1073741824" returned: 0 in 0.742s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2a2aff90-76bb-4a21-9304-03b3cab3010e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:36 devstack sudo[84777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2a2aff90-76bb-4a21-9304-03b3cab3010e Apr 07 06:07:36 devstack sudo[84777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:37 devstack sudo[84777]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2a2aff90-76bb-4a21-9304-03b3cab3010e" returned: 0 in 1.119s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:37 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:07:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80825aca-cbcf-4a5f-94e6-1b49673b2141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a2aff90-76bb-4a21-9304-03b3cab3010e', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a787b23-d6f5-41bf-b42b-04a32f0c0959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:37 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Volume volume-2a2aff90-76bb-4a21-9304-03b3cab3010e (2a2aff90-76bb-4a21-9304-03b3cab3010e): created successfully Apr 07 06:07:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a787b23-d6f5-41bf-b42b-04a32f0c0959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Flow 'volume_create_manager' (86eeac56-619c-4bd9-b816-e0746944006c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:07:37 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-bff07319-6166-47df-92ad-48507e035f69 tempest-VolumeQuotasNegativeTestJSON-425229531 None] Created volume successfully. Apr 07 06:07:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] Acquiring lock "cinder-2a2aff90-76bb-4a21-9304-03b3cab3010e-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] Lock "cinder-2a2aff90-76bb-4a21-9304-03b3cab3010e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] Acquiring lock "cinder-quobyte-2a2aff90-76bb-4a21-9304-03b3cab3010e" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:07:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] Lock "cinder-quobyte-2a2aff90-76bb-4a21-9304-03b3cab3010e" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:07:40 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5641338-ed77-466a-b1c6-51859922550f]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2a2aff90-76bb-4a21-9304-03b3cab3010e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:40 devstack sudo[84813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2a2aff90-76bb-4a21-9304-03b3cab3010e Apr 07 06:07:40 devstack sudo[84813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:41 devstack sudo[84813]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2a2aff90-76bb-4a21-9304-03b3cab3010e" returned: 0 in 1.230s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2a2aff90-76bb-4a21-9304-03b3cab3010e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:41 devstack sudo[84820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2a2aff90-76bb-4a21-9304-03b3cab3010e Apr 07 06:07:41 devstack sudo[84820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:42 devstack sudo[84820]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2a2aff90-76bb-4a21-9304-03b3cab3010e" returned: 0 in 1.202s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:42 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] Lock "cinder-quobyte-2a2aff90-76bb-4a21-9304-03b3cab3010e" released by "delete_volume" :: held 2.524s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:42 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] Created reservations ['804b3f0b-69fb-450d-a587-168a6c937eef', 'f0b6dfdf-51fd-4413-a2a4-eb7ea07c692e', '4f7b16ba-8b15-41e8-8718-444b47971cf7', '71c49045-9dbb-48e3-b939-521afe49ee77'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:07:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:07:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:07:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:42 devstack sudo[84831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:07:42 devstack sudo[84831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:43 devstack sudo[84831]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.933s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:43 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:07:43 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] Deleted volume successfully. Apr 07 06:07:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-331fad72-d8a4-4187-8118-b3c3533b6c9f tempest-VolumeQuotasNegativeTestJSON-425229531 None] Lock "cinder-2a2aff90-76bb-4a21-9304-03b3cab3010e-delete_volume" released by "delete_volume" :: held 3.835s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:07:50 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:07:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Flow 'volume_create_manager' (dd64fef5-90be-4c10-84e7-bf128071bd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:07:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f97ef6-fa98-4db2-bb73-c802bb411284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f97ef6-fa98-4db2-bb73-c802bb411284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:07:50Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311d7112-68b9-446c-8988-526825b6206b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34703ed4f2744f2d87025ae2e6bd2b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:07:50Z,use_quota=True,user_id='f930f64cc2c341abaff51446966a1fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a607fedf-612f-42e6-b716-831bfad5528c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a607fedf-612f-42e6-b716-831bfad5528c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5c649f-b130-44f6-82ff-49e66b3ef4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:50 devstack cinder-volume[82475]: DEBUG cinder.image.glance [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Creating Keystone auth plugin from conf {{(pid=82475) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 07 06:07:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5c649f-b130-44f6-82ff-49e66b3ef4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '311d7112-68b9-446c-8988-526825b6206b', 'volume_name': 'volume-311d7112-68b9-446c-8988-526825b6206b', 'volume_size': 1, 'image_id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b1699f15f0f4ed99342800159112237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e597d39-f7d0-437d-988f-e2351ab702ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf4cca2-110e-4984-8067-a4521694c0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf4cca2-110e-4984-8067-a4521694c0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:07:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140f0fb0-8711-4121-a8d3-c18c3ea6467b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:07:51 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Volume 311d7112-68b9-446c-8988-526825b6206b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-311d7112-68b9-446c-8988-526825b6206b', 'volume_size': 1, 'image_id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b1699f15f0f4ed99342800159112237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e597d39-f7d0-437d-988f-e2351ab702ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 07 06:07:51 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Trying to clone 311d7112-68b9-446c-8988-526825b6206b from image 2e597d39-f7d0-437d-988f-e2351ab702ec at location (None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}]). {{(pid=82475) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 07 06:07:51 devstack cinder-volume[82475]: DEBUG oslo_service.periodic_task [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82475) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:07:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:07:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:07:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:51 devstack sudo[84866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:07:51 devstack sudo[84866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:51 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_bxm7diokdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82475) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 07 06:07:51 devstack cinder-volume[82475]: INFO cinder.image.image_utils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Image download 20.69 MB at 20.69 MB/s Apr 07 06:07:52 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[32485b1e-63b7-4bde-a32e-acb1fb81064d]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_bxm7diokdevstack@QuobyteHD {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:52 devstack sudo[84868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_bxm7diokdevstack@QuobyteHD Apr 07 06:07:52 devstack sudo[84868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:53 devstack sudo[84868]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_bxm7diokdevstack@QuobyteHD" returned: 0 in 1.305s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:53 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Temporary image 2e597d39-f7d0-437d-988f-e2351ab702ec is fetched for user f930f64cc2c341abaff51446966a1fc6. {{(pid=82475) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 07 06:07:53 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae48a3a-6977-4637-8121-5a2efb03e87d]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_bxm7diokdevstack@QuobyteHD {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:53 devstack sudo[84866]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 1.674s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:53 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:07:53 devstack sudo[84889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_bxm7diokdevstack@QuobyteHD Apr 07 06:07:53 devstack sudo[84889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:54 devstack sudo[84889]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_bxm7diokdevstack@QuobyteHD" returned: 0 in 0.990s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:07:50Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311d7112-68b9-446c-8988-526825b6206b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34703ed4f2744f2d87025ae2e6bd2b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:07:50Z,use_quota=True,user_id='f930f64cc2c341abaff51446966a1fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:07:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Creating volume 311d7112-68b9-446c-8988-526825b6206b {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:07:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:07:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:07:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:07:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:07:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:07:54 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:07:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:54 devstack sudo[84899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b 1073741824 Apr 07 06:07:54 devstack sudo[84899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:55 devstack sudo[84899]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b 1073741824" returned: 0 in 1.341s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:56 devstack sudo[84904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b Apr 07 06:07:56 devstack sudo[84904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:57 devstack sudo[84904]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b" returned: 0 in 1.534s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] <== create_volume: return (2971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:07:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.975s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:07:57 devstack cinder-volume[82475]: DEBUG cinder.volume.volume_utils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Attempting download of 2e597d39-f7d0-437d-988f-e2351ab702ec ((None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}])) to volume 311d7112-68b9-446c-8988-526825b6206b. {{(pid=82475) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 07 06:07:57 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bf508a-8366-46ee-86c4-a3a580410c3a]: (4, 'raw') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_ucz7u0_h {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:57 devstack sudo[84934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_ucz7u0_h Apr 07 06:07:57 devstack sudo[84934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:58 devstack sudo[84934]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_ucz7u0_h" returned: 0 in 0.938s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_ucz7u0_h {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:58 devstack sudo[84938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_ucz7u0_h Apr 07 06:07:58 devstack sudo[84938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:07:59 devstack sudo[84938]: pam_unix(sudo:session): session closed for user root Apr 07 06:07:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_ucz7u0_h" returned: 1 in 0.946s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:07:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_ucz7u0_h' failed. Not Retrying. {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:07:59 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f87633-5185-4b3a-b700-2abeb8bd4df6]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:07:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_bxm7diokdevstack@QuobyteHD {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:07:59 devstack sudo[84943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_bxm7diokdevstack@QuobyteHD Apr 07 06:07:59 devstack sudo[84943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:00 devstack sudo[84943]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_bxm7diokdevstack@QuobyteHD" returned: 0 in 1.234s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:00 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] 2e597d39-f7d0-437d-988f-e2351ab702ec was qcow2, converting to raw {{(pid=82475) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 07 06:08:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_bxm7diokdevstack@QuobyteHD /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:00 devstack sudo[84948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_bxm7diokdevstack@QuobyteHD /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b Apr 07 06:08:00 devstack sudo[84948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:02 devstack sudo[84948]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_bxm7diokdevstack@QuobyteHD /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b" returned: 0 in 2.040s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:02 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_bxm7diokdevstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:08:02 devstack cinder-volume[82475]: INFO cinder.image.image_utils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Converted 112.00 MB image at 54.87 MB/s Apr 07 06:08:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:02 devstack sudo[84974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b 1G Apr 07 06:08:02 devstack sudo[84974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:04 devstack sudo[84974]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b 1G" returned: 0 in 1.542s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:04 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c0e58e-76fb-43dd-9f34-65ec8bac3d62]: (4, 'raw') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:04 devstack sudo[85004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b Apr 07 06:08:04 devstack sudo[85004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:06 devstack sudo[85004]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b" returned: 0 in 1.624s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:06 devstack sudo[85019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b Apr 07 06:08:06 devstack sudo[85019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:07 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:SELECT=19,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=2 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:08:07 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:SELECT=15,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=2 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:08:07 devstack sudo[85019]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b" returned: 1 in 1.380s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b' failed. Not Retrying. {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:08:07 devstack cinder-volume[82475]: DEBUG cinder.volume.volume_utils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Downloaded image 2e597d39-f7d0-437d-988f-e2351ab702ec ((None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}])) to volume 311d7112-68b9-446c-8988-526825b6206b successfully. {{(pid=82475) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 07 06:08:07 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Temporary image 2e597d39-f7d0-437d-988f-e2351ab702ec for user f930f64cc2c341abaff51446966a1fc6 is deleted. {{(pid=82475) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 07 06:08:07 devstack cinder-volume[82475]: DEBUG cinder.volume.volume_utils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Marking volume 311d7112-68b9-446c-8988-526825b6206b as bootable. {{(pid=82475) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 07 06:08:07 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Copying metadata from image 2e597d39-f7d0-437d-988f-e2351ab702ec to 311d7112-68b9-446c-8988-526825b6206b. {{(pid=82475) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 07 06:08:07 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Creating volume glance metadata for volume 311d7112-68b9-446c-8988-526825b6206b backed by image 2e597d39-f7d0-437d-988f-e2351ab702ec with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82475) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 07 06:08:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140f0fb0-8711-4121-a8d3-c18c3ea6467b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-311d7112-68b9-446c-8988-526825b6206b', 'volume_size': 1, 'image_id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b1699f15f0f4ed99342800159112237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e597d39-f7d0-437d-988f-e2351ab702ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62cf19b5-7c6e-410d-be2a-992af71ad172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:07 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Volume volume-311d7112-68b9-446c-8988-526825b6206b (311d7112-68b9-446c-8988-526825b6206b): created successfully Apr 07 06:08:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62cf19b5-7c6e-410d-be2a-992af71ad172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Flow 'volume_create_manager' (dd64fef5-90be-4c10-84e7-bf128071bd92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:07 devstack cinder-volume[82475]: INFO cinder.volume.manager [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-a4e5179a-89b7-4b1a-aad1-2355b6bfbe19 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Created volume successfully. Apr 07 06:08:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-ca583df1-d758-447b-8c58-a7c8927359ac tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-ca583df1-d758-447b-8c58-a7c8927359ac tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:10 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee1d2a6-01e5-4dc8-a3eb-e7e8c8707b8f]: (4, 'raw') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-ca583df1-d758-447b-8c58-a7c8927359ac tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:10 devstack sudo[85074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b Apr 07 06:08:10 devstack sudo[85074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:11 devstack sudo[85074]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-ca583df1-d758-447b-8c58-a7c8927359ac tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b" returned: 0 in 1.549s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-ca583df1-d758-447b-8c58-a7c8927359ac tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:11 devstack sudo[85114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b Apr 07 06:08:12 devstack sudo[85114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:13 devstack sudo[85114]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-ca583df1-d758-447b-8c58-a7c8927359ac tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b" returned: 1 in 1.619s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-ca583df1-d758-447b-8c58-a7c8927359ac tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b' failed. Not Retrying. {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:08:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-ca583df1-d758-447b-8c58-a7c8927359ac tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.279s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:13 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-ca583df1-d758-447b-8c58-a7c8927359ac tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7', 'name': 'volume-311d7112-68b9-446c-8988-526825b6206b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65374756-02c0-400d-ae5e-afd0a7ff5a3c', 'enforce_multipath': True} {{(pid=82475) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 07 06:08:13 devstack cinder-volume[82475]: INFO cinder.volume.manager [req-23dd7423-83b0-4f48-a970-6b7f34a94259 req-ca583df1-d758-447b-8c58-a7c8927359ac tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] attachment_update completed successfully. Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Flow 'volume_create_manager' (cf3f0a38-3601-44ab-8caa-ae459c16d3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146670a7-e6a3-4cb5-a0a6-251b7e4a6708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146670a7-e6a3-4cb5-a0a6-251b7e4a6708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-905686538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10cc9434-1b6c-43ad-afb7-97d3c03eefd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9101074801345fc805dc4e23b7bc501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:15Z,use_quota=True,user_id='0ac4baa7708d4cf0b6bbf96bec5184b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb6518b-f51d-4ef3-96ea-a41428b2d5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb6518b-f51d-4ef3-96ea-a41428b2d5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c253c757-8276-4b44-845f-cbfcecec7a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c253c757-8276-4b44-845f-cbfcecec7a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10cc9434-1b6c-43ad-afb7-97d3c03eefd6', 'volume_name': 'volume-10cc9434-1b6c-43ad-afb7-97d3c03eefd6', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17f416d-315c-4442-852d-d33785933031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17f416d-315c-4442-852d-d33785933031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b519308b-c54c-4228-a65e-d0d219998bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:15 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Volume 10cc9434-1b6c-43ad-afb7-97d3c03eefd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10cc9434-1b6c-43ad-afb7-97d3c03eefd6', 'volume_size': 1} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-905686538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10cc9434-1b6c-43ad-afb7-97d3c03eefd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9101074801345fc805dc4e23b7bc501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:15Z,use_quota=True,user_id='0ac4baa7708d4cf0b6bbf96bec5184b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Creating volume 10cc9434-1b6c-43ad-afb7-97d3c03eefd6 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:08:15 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:08:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-10cc9434-1b6c-43ad-afb7-97d3c03eefd6 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:15 devstack sudo[85121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-10cc9434-1b6c-43ad-afb7-97d3c03eefd6 1073741824 Apr 07 06:08:15 devstack sudo[85121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:16 devstack sudo[85121]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-10cc9434-1b6c-43ad-afb7-97d3c03eefd6 1073741824" returned: 0 in 1.176s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-10cc9434-1b6c-43ad-afb7-97d3c03eefd6 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:16 devstack sudo[85163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-10cc9434-1b6c-43ad-afb7-97d3c03eefd6 Apr 07 06:08:16 devstack sudo[85163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:17 devstack sudo[85163]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-10cc9434-1b6c-43ad-afb7-97d3c03eefd6" returned: 0 in 0.707s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:08:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:17 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b519308b-c54c-4228-a65e-d0d219998bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10cc9434-1b6c-43ad-afb7-97d3c03eefd6', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:17 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f346b954-97ae-4f47-bef5-fcfa11b81f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:17 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Volume volume-10cc9434-1b6c-43ad-afb7-97d3c03eefd6 (10cc9434-1b6c-43ad-afb7-97d3c03eefd6): created successfully Apr 07 06:08:17 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f346b954-97ae-4f47-bef5-fcfa11b81f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:17 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Flow 'volume_create_manager' (cf3f0a38-3601-44ab-8caa-ae459c16d3df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:17 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-85705f40-c076-4aa3-837d-46ab97176b04 tempest-VolumesTransfersV357Test-621655779 None] Created volume successfully. Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Flow 'volume_create_manager' (6ad36f54-b610-4bca-8b3e-e6a73ba72153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3f6eb0-5f3c-48d2-b468-f27fc11c1764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3f6eb0-5f3c-48d2-b468-f27fc11c1764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1705497347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b2317e-df6e-494a-8df9-f2e7a0d46c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55834b50d5843019d4775ed0256ae15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:19Z,use_quota=True,user_id='44244e7bb3e543d181157eff636cc380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bdafcfd-0469-45ab-a920-d4432e62c9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bdafcfd-0469-45ab-a920-d4432e62c9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54618b3e-238f-49e0-8fc4-177f2d0eda70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54618b3e-238f-49e0-8fc4-177f2d0eda70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b2317e-df6e-494a-8df9-f2e7a0d46c3f', 'volume_name': 'volume-12b2317e-df6e-494a-8df9-f2e7a0d46c3f', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3c11a5-a732-4284-a5fc-56f638eb9a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3c11a5-a732-4284-a5fc-56f638eb9a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a777712-a747-4413-b50d-604b53bcb794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:18 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Volume 12b2317e-df6e-494a-8df9-f2e7a0d46c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b2317e-df6e-494a-8df9-f2e7a0d46c3f', 'volume_size': 1} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1705497347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b2317e-df6e-494a-8df9-f2e7a0d46c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55834b50d5843019d4775ed0256ae15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:19Z,use_quota=True,user_id='44244e7bb3e543d181157eff636cc380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Creating volume 12b2317e-df6e-494a-8df9-f2e7a0d46c3f {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:08:18 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:08:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12b2317e-df6e-494a-8df9-f2e7a0d46c3f 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:19 devstack sudo[85191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12b2317e-df6e-494a-8df9-f2e7a0d46c3f 1073741824 Apr 07 06:08:19 devstack sudo[85191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:20 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-9ea0a04b-9c32-4200-8dc8-d68a6f6e118b tempest-VolumesTransfersV357Test-78206007 None] Transfer volume completed successfully. Apr 07 06:08:20 devstack sudo[85191]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12b2317e-df6e-494a-8df9-f2e7a0d46c3f 1073741824" returned: 0 in 1.954s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12b2317e-df6e-494a-8df9-f2e7a0d46c3f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:21 devstack sudo[85201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12b2317e-df6e-494a-8df9-f2e7a0d46c3f Apr 07 06:08:21 devstack sudo[85201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] Acquiring lock "cinder-10cc9434-1b6c-43ad-afb7-97d3c03eefd6-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] Lock "cinder-10cc9434-1b6c-43ad-afb7-97d3c03eefd6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] Acquiring lock "cinder-quobyte-10cc9434-1b6c-43ad-afb7-97d3c03eefd6" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] Lock "cinder-quobyte-10cc9434-1b6c-43ad-afb7-97d3c03eefd6" acquired by "delete_volume" :: waited 0.039s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:21 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[438606f1-5064-4a54-ae27-6564e8ed2440]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-10cc9434-1b6c-43ad-afb7-97d3c03eefd6 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:22 devstack sudo[85203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-10cc9434-1b6c-43ad-afb7-97d3c03eefd6 Apr 07 06:08:22 devstack sudo[85203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:22 devstack sudo[85201]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12b2317e-df6e-494a-8df9-f2e7a0d46c3f" returned: 0 in 1.234s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] <== create_volume: return (3264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:08:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.271s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a777712-a747-4413-b50d-604b53bcb794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b2317e-df6e-494a-8df9-f2e7a0d46c3f', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81841aa-4069-4a39-af38-1f89c91ad500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:22 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Volume volume-12b2317e-df6e-494a-8df9-f2e7a0d46c3f (12b2317e-df6e-494a-8df9-f2e7a0d46c3f): created successfully Apr 07 06:08:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81841aa-4069-4a39-af38-1f89c91ad500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Flow 'volume_create_manager' (6ad36f54-b610-4bca-8b3e-e6a73ba72153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:22 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-f349c117-0705-4014-98e2-eca0196c07e9 tempest-ServersNegativeTestJSON-749531362 None] Created volume successfully. Apr 07 06:08:22 devstack sudo[85203]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-10cc9434-1b6c-43ad-afb7-97d3c03eefd6" returned: 0 in 1.000s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-10cc9434-1b6c-43ad-afb7-97d3c03eefd6 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:23 devstack sudo[85209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-10cc9434-1b6c-43ad-afb7-97d3c03eefd6 Apr 07 06:08:23 devstack sudo[85209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:23 devstack sudo[85209]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-10cc9434-1b6c-43ad-afb7-97d3c03eefd6" returned: 0 in 0.628s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:23 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] Lock "cinder-quobyte-10cc9434-1b6c-43ad-afb7-97d3c03eefd6" released by "delete_volume" :: held 1.720s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:23 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] Created reservations ['956ba75e-5492-42a7-92dd-5333031fd980', 'f4b00859-401e-4876-8401-b80806b03ea8', '89ea8102-ec0f-41df-b17e-76905c82156a', '4a4a5de0-d3c1-41b6-ab0d-33292fa95ef1'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:23 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:23 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:23 devstack sudo[85217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:08:23 devstack sudo[85217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Flow 'volume_create_manager' (6b308764-66c8-4d83-9922-81e0a26e67f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc224a4-087e-46bb-9c64-d29254867015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc224a4-087e-46bb-9c64-d29254867015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-896515988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719e9c87-57a3-40db-a857-c9ca20382723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9101074801345fc805dc4e23b7bc501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:25Z,use_quota=True,user_id='0ac4baa7708d4cf0b6bbf96bec5184b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d395a4f6-fce2-489c-b5d6-60e4030bba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d395a4f6-fce2-489c-b5d6-60e4030bba77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13921334-5b9f-4066-89d9-7b2f36b01141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13921334-5b9f-4066-89d9-7b2f36b01141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '719e9c87-57a3-40db-a857-c9ca20382723', 'volume_name': 'volume-719e9c87-57a3-40db-a857-c9ca20382723', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba4b43c-db30-440f-a3c2-874a13b8f132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba4b43c-db30-440f-a3c2-874a13b8f132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42fc20e-0f44-4b98-b8c6-ff5ff207ebbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:24 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Volume 719e9c87-57a3-40db-a857-c9ca20382723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-719e9c87-57a3-40db-a857-c9ca20382723', 'volume_size': 1} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-896515988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719e9c87-57a3-40db-a857-c9ca20382723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9101074801345fc805dc4e23b7bc501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:25Z,use_quota=True,user_id='0ac4baa7708d4cf0b6bbf96bec5184b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Creating volume 719e9c87-57a3-40db-a857-c9ca20382723 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:08:24 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-719e9c87-57a3-40db-a857-c9ca20382723 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:24 devstack sudo[85217]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 1.010s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:08:24 devstack sudo[85221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-719e9c87-57a3-40db-a857-c9ca20382723 1073741824 Apr 07 06:08:24 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] Deleted volume successfully. Apr 07 06:08:24 devstack sudo[85221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:24 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-dbf0230d-88d5-496c-9333-ae7adaac9e21 tempest-VolumesTransfersV357Test-1983932734 None] Lock "cinder-10cc9434-1b6c-43ad-afb7-97d3c03eefd6-delete_volume" released by "delete_volume" :: held 3.239s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:25 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:08:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Flow 'volume_create_manager' (fae0b517-9f28-4c1f-bbf0-2796a6f59b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a605f42-addc-4b5c-b18b-09be6d0c1736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a605f42-addc-4b5c-b18b-09be6d0c1736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-445994017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55834b50d5843019d4775ed0256ae15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:25Z,use_quota=True,user_id='44244e7bb3e543d181157eff636cc380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710b85ea-41d2-409f-8bf7-9ced9f1c8073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710b85ea-41d2-409f-8bf7-9ced9f1c8073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387febfe-df74-4051-a2e2-ed67b4cde35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387febfe-df74-4051-a2e2-ed67b4cde35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d', 'volume_name': 'volume-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c8264f-62f9-41e5-b676-a214c3d70c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c8264f-62f9-41e5-b676-a214c3d70c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6279c85f-a565-48f5-b49d-65bdb3f56d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:25 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Volume 2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d', 'volume_size': 1} Apr 07 06:08:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:25 devstack sudo[85221]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-719e9c87-57a3-40db-a857-c9ca20382723 1073741824" returned: 0 in 0.894s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-719e9c87-57a3-40db-a857-c9ca20382723 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:25 devstack sudo[85226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-719e9c87-57a3-40db-a857-c9ca20382723 Apr 07 06:08:25 devstack sudo[85226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:26 devstack sudo[85226]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-719e9c87-57a3-40db-a857-c9ca20382723" returned: 0 in 0.551s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:08:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.765s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-445994017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55834b50d5843019d4775ed0256ae15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:25Z,use_quota=True,user_id='44244e7bb3e543d181157eff636cc380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:08:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Creating volume 2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:08:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:08:26 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:08:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42fc20e-0f44-4b98-b8c6-ff5ff207ebbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-719e9c87-57a3-40db-a857-c9ca20382723', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb44b3fb-5e77-447e-8a48-ad8f1763cc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:26 devstack sudo[85229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d 1073741824 Apr 07 06:08:26 devstack sudo[85229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:26 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Volume volume-719e9c87-57a3-40db-a857-c9ca20382723 (719e9c87-57a3-40db-a857-c9ca20382723): created successfully Apr 07 06:08:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb44b3fb-5e77-447e-8a48-ad8f1763cc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Flow 'volume_create_manager' (6b308764-66c8-4d83-9922-81e0a26e67f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:26 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-b0a858d3-e27a-40a2-b6f8-aa77c8639e10 tempest-VolumesTransfersV357Test-621655779 None] Created volume successfully. Apr 07 06:08:27 devstack sudo[85229]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d 1073741824" returned: 0 in 0.820s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:27 devstack sudo[85254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d Apr 07 06:08:27 devstack sudo[85254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] Acquiring lock "cinder-719e9c87-57a3-40db-a857-c9ca20382723-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] Lock "cinder-719e9c87-57a3-40db-a857-c9ca20382723-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] Acquiring lock "cinder-quobyte-719e9c87-57a3-40db-a857-c9ca20382723" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] Lock "cinder-quobyte-719e9c87-57a3-40db-a857-c9ca20382723" acquired by "delete_volume" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:27 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[04db3711-3d80-4c72-9901-10b1c24ead24]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-719e9c87-57a3-40db-a857-c9ca20382723 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:27 devstack sudo[85256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-719e9c87-57a3-40db-a857-c9ca20382723 Apr 07 06:08:27 devstack sudo[85256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:27 devstack sudo[85254]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d" returned: 0 in 0.562s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:27 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:08:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6279c85f-a565-48f5-b49d-65bdb3f56d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da62d64c-12dc-4d2b-9b6a-bebc4fa53741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:28 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Volume volume-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d (2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d): created successfully Apr 07 06:08:28 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da62d64c-12dc-4d2b-9b6a-bebc4fa53741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:28 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Flow 'volume_create_manager' (fae0b517-9f28-4c1f-bbf0-2796a6f59b32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:28 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-94c5e559-d48e-4c84-a4e0-31181f30b2fb tempest-ServersNegativeTestJSON-749531362 None] Created volume successfully. Apr 07 06:08:28 devstack sudo[85256]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-719e9c87-57a3-40db-a857-c9ca20382723" returned: 0 in 0.592s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-719e9c87-57a3-40db-a857-c9ca20382723 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:28 devstack sudo[85262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-719e9c87-57a3-40db-a857-c9ca20382723 Apr 07 06:08:28 devstack sudo[85262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:28 devstack sudo[85262]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-719e9c87-57a3-40db-a857-c9ca20382723" returned: 0 in 0.603s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:28 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] Lock "cinder-quobyte-719e9c87-57a3-40db-a857-c9ca20382723" released by "delete_volume" :: held 1.219s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:28 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] Created reservations ['46e3737d-e0ca-4d47-ba3e-fad7369ed67d', '0152f7b8-6afa-4919-ae36-c4a0a7168b7c', 'be4a0347-e18a-4695-a55d-3c6dbdd38a72', '57fdf9cb-a4ec-4a1b-a7f5-fd02be2e42ed'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:28 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:28 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:28 devstack sudo[85269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:08:28 devstack sudo[85269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:29 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] Acquiring lock "cinder-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:29 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] Lock "cinder-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:29 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] Acquiring lock "cinder-quobyte-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:29 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] Lock "cinder-quobyte-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:29 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d23791f-d343-4338-bfc9-d32f541bc080]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:29 devstack sudo[85281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d Apr 07 06:08:29 devstack sudo[85281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:29 devstack sudo[85269]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.593s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:29 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:08:29 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] Deleted volume successfully. Apr 07 06:08:29 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-77242ea6-920f-497c-8f31-281cd033181f tempest-VolumesTransfersV357Test-1983932734 None] Lock "cinder-719e9c87-57a3-40db-a857-c9ca20382723-delete_volume" released by "delete_volume" :: held 2.004s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:29 devstack sudo[85281]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d" returned: 0 in 0.824s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:30 devstack sudo[85296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d Apr 07 06:08:30 devstack sudo[85296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:30 devstack sudo[85296]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d" returned: 0 in 0.610s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:30 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] Lock "cinder-quobyte-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d" released by "delete_volume" :: held 1.477s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:30 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] Created reservations ['7a95b80c-0584-49c8-8c17-cd1b9202402f', '88787df3-2820-4afc-805e-5c28195feffe', 'a9fcefcc-2bb7-4258-8072-c14740c60ec8', 'd69f210b-0da5-4b72-9f98-452b1d978acc'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:30 devstack sudo[85301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:08:30 devstack sudo[85301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] Acquiring lock "cinder-12b2317e-df6e-494a-8df9-f2e7a0d46c3f-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] Lock "cinder-12b2317e-df6e-494a-8df9-f2e7a0d46c3f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:31 devstack sudo[85301]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.760s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:31 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:08:31 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] Deleted volume successfully. Apr 07 06:08:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] Acquiring lock "cinder-quobyte-12b2317e-df6e-494a-8df9-f2e7a0d46c3f" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-35d838dd-ce44-435a-8a07-8543dceb8c9e tempest-ServersNegativeTestJSON-749531362 None] Lock "cinder-2344919b-e5fc-40ca-8e28-fe8c8d4f2f7d-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] Lock "cinder-quobyte-12b2317e-df6e-494a-8df9-f2e7a0d46c3f" acquired by "delete_volume" :: waited 0.020s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:31 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[5021069b-f302-41f8-b544-0e77c55be220]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12b2317e-df6e-494a-8df9-f2e7a0d46c3f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:31 devstack sudo[85319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12b2317e-df6e-494a-8df9-f2e7a0d46c3f Apr 07 06:08:31 devstack sudo[85319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:32 devstack sudo[85319]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12b2317e-df6e-494a-8df9-f2e7a0d46c3f" returned: 0 in 0.586s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12b2317e-df6e-494a-8df9-f2e7a0d46c3f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:32 devstack sudo[85324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12b2317e-df6e-494a-8df9-f2e7a0d46c3f Apr 07 06:08:32 devstack sudo[85324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:32 devstack sudo[85324]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12b2317e-df6e-494a-8df9-f2e7a0d46c3f" returned: 0 in 0.652s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:32 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] Lock "cinder-quobyte-12b2317e-df6e-494a-8df9-f2e7a0d46c3f" released by "delete_volume" :: held 1.270s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:32 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] Created reservations ['4ac59ffa-7f4d-4370-9bd3-333843ffb480', '42b8ccfb-78fa-4447-a96d-5d02b490883c', 'f98a60fe-c509-4fe5-9f0c-aca03370c516', '027af488-a1a8-450e-819a-cf66fb14c9c3'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:32 devstack sudo[85329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:08:32 devstack sudo[85329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:33 devstack sudo[85329]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.545s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:33 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:08:33 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] Deleted volume successfully. Apr 07 06:08:33 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b52b1a70-0e3a-406a-b8ec-c717d81f2f71 tempest-ServersNegativeTestJSON-749531362 None] Lock "cinder-12b2317e-df6e-494a-8df9-f2e7a0d46c3f-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Flow 'volume_create_manager' (14598fac-0ed1-45bc-8ace-e2b2f890922c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7470e77-9ef5-4006-9a80-79f71af61aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7470e77-9ef5-4006-9a80-79f71af61aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1867945908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=039373a0-243b-42f1-b3f8-ce3bc83280e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c78f002ab840b8abeea84e75cfe67a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:41Z,use_quota=True,user_id='193ea49c130e47ad954b9824e3d71fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ba54e8-a8be-42d0-801f-8720c58feed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ba54e8-a8be-42d0-801f-8720c58feed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f6f1e2-2112-4b49-a611-9e81423cf7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f6f1e2-2112-4b49-a611-9e81423cf7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '039373a0-243b-42f1-b3f8-ce3bc83280e2', 'volume_name': 'volume-039373a0-243b-42f1-b3f8-ce3bc83280e2', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265bcbcb-4bff-4432-9154-45250136444e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265bcbcb-4bff-4432-9154-45250136444e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f193c63e-d9c0-43a3-8e69-70e83bf9a532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:41 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Volume 039373a0-243b-42f1-b3f8-ce3bc83280e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-039373a0-243b-42f1-b3f8-ce3bc83280e2', 'volume_size': 1} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1867945908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=039373a0-243b-42f1-b3f8-ce3bc83280e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c78f002ab840b8abeea84e75cfe67a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:41Z,use_quota=True,user_id='193ea49c130e47ad954b9824e3d71fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Creating volume 039373a0-243b-42f1-b3f8-ce3bc83280e2 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:08:41 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:08:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-039373a0-243b-42f1-b3f8-ce3bc83280e2 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:41 devstack sudo[85485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-039373a0-243b-42f1-b3f8-ce3bc83280e2 1073741824 Apr 07 06:08:41 devstack sudo[85485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:42 devstack sudo[85485]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-039373a0-243b-42f1-b3f8-ce3bc83280e2 1073741824" returned: 0 in 1.042s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-039373a0-243b-42f1-b3f8-ce3bc83280e2 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:42 devstack sudo[85490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-039373a0-243b-42f1-b3f8-ce3bc83280e2 Apr 07 06:08:42 devstack sudo[85490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:43 devstack sudo[85490]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-039373a0-243b-42f1-b3f8-ce3bc83280e2" returned: 0 in 1.109s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:43 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] <== create_volume: return (2267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:08:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.279s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:43 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f193c63e-d9c0-43a3-8e69-70e83bf9a532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-039373a0-243b-42f1-b3f8-ce3bc83280e2', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:43 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97de66a7-13fd-4084-ab29-5cb5966fcfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:43 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Volume volume-039373a0-243b-42f1-b3f8-ce3bc83280e2 (039373a0-243b-42f1-b3f8-ce3bc83280e2): created successfully Apr 07 06:08:43 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97de66a7-13fd-4084-ab29-5cb5966fcfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:43 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Flow 'volume_create_manager' (14598fac-0ed1-45bc-8ace-e2b2f890922c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:43 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-2ec75fd4-e1b1-41d8-9c42-7e15f6dede3b tempest-DeleteServersTestJSON-859674876 None] Created volume successfully. Apr 07 06:08:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-f9016049-d13b-4cbf-9af7-c89e2530b797 req-f0cd9d9a-7ea4-4044-a752-d97237539a67 tempest-DeleteServersTestJSON-859674876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-f9016049-d13b-4cbf-9af7-c89e2530b797 req-f0cd9d9a-7ea4-4044-a752-d97237539a67 tempest-DeleteServersTestJSON-859674876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:48 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daae1eb-b839-4de9-a74f-783c695f650d]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-f9016049-d13b-4cbf-9af7-c89e2530b797 req-f0cd9d9a-7ea4-4044-a752-d97237539a67 tempest-DeleteServersTestJSON-859674876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-039373a0-243b-42f1-b3f8-ce3bc83280e2 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:48 devstack sudo[85534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-039373a0-243b-42f1-b3f8-ce3bc83280e2 Apr 07 06:08:48 devstack sudo[85534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:49 devstack sudo[85534]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-f9016049-d13b-4cbf-9af7-c89e2530b797 req-f0cd9d9a-7ea4-4044-a752-d97237539a67 tempest-DeleteServersTestJSON-859674876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-039373a0-243b-42f1-b3f8-ce3bc83280e2" returned: 0 in 1.360s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-f9016049-d13b-4cbf-9af7-c89e2530b797 req-f0cd9d9a-7ea4-4044-a752-d97237539a67 tempest-DeleteServersTestJSON-859674876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.382s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Flow 'volume_create_manager' (fe268537-22b8-49ae-80c6-728d43bf5c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47eebcdf-abe1-4f90-bf4b-dcad115248f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-f9016049-d13b-4cbf-9af7-c89e2530b797 req-f0cd9d9a-7ea4-4044-a752-d97237539a67 tempest-DeleteServersTestJSON-859674876 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7', 'name': 'volume-039373a0-243b-42f1-b3f8-ce3bc83280e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00ece667-f9de-4e39-9540-af591184f9c5', 'enforce_multipath': True} {{(pid=82475) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47eebcdf-abe1-4f90-bf4b-dcad115248f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2068167168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27db357-b40d-4db2-bd33-fd4803e7f285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf77e66fb8514642915e1fe986241335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:50Z,use_quota=True,user_id='c69fa9012f7b438eaa19fb3e3fb41bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884beba5-ae45-4dd5-a28f-0fab6c18c22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884beba5-ae45-4dd5-a28f-0fab6c18c22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1961b3-249c-4661-9bc5-d5e81db9b2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1961b3-249c-4661-9bc5-d5e81db9b2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a27db357-b40d-4db2-bd33-fd4803e7f285', 'volume_name': 'volume-a27db357-b40d-4db2-bd33-fd4803e7f285', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5a7aea-8a53-41df-9077-b13217650057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5a7aea-8a53-41df-9077-b13217650057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0d4778-0100-4355-aa3b-6b68787a621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:49 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Volume a27db357-b40d-4db2-bd33-fd4803e7f285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a27db357-b40d-4db2-bd33-fd4803e7f285', 'volume_size': 1} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2068167168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27db357-b40d-4db2-bd33-fd4803e7f285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf77e66fb8514642915e1fe986241335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:50Z,use_quota=True,user_id='c69fa9012f7b438eaa19fb3e3fb41bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Creating volume a27db357-b40d-4db2-bd33-fd4803e7f285 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:08:49 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:08:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:49 devstack sudo[85542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 1073741824 Apr 07 06:08:49 devstack sudo[85542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:49 devstack cinder-volume[82475]: INFO cinder.volume.manager [req-f9016049-d13b-4cbf-9af7-c89e2530b797 req-f0cd9d9a-7ea4-4044-a752-d97237539a67 tempest-DeleteServersTestJSON-859674876 None] attachment_update completed successfully. Apr 07 06:08:50 devstack cinder-volume[82475]: INFO cinder.volume.manager [req-832e974d-22a6-41df-967a-844148916634 req-d66f91f2-fae0-44aa-8b60-08496b1cde98 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Terminate volume connection completed successfully. Apr 07 06:08:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-832e974d-22a6-41df-967a-844148916634 req-d66f91f2-fae0-44aa-8b60-08496b1cde98 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Deleting attachment 65374756-02c0-400d-ae5e-afd0a7ff5a3c. {{(pid=82475) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 07 06:08:50 devstack sudo[85542]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 1073741824" returned: 0 in 0.662s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:50 devstack sudo[85547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 Apr 07 06:08:50 devstack sudo[85547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Acquiring lock "cinder-311d7112-68b9-446c-8988-526825b6206b-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "cinder-311d7112-68b9-446c-8988-526825b6206b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Acquiring lock "cinder-quobyte-311d7112-68b9-446c-8988-526825b6206b" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "cinder-quobyte-311d7112-68b9-446c-8988-526825b6206b" acquired by "delete_volume" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fc0027-2e18-4487-a43e-85f529ab970f]: (4, 'raw') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:51 devstack sudo[85547]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285" returned: 0 in 0.545s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0d4778-0100-4355-aa3b-6b68787a621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a27db357-b40d-4db2-bd33-fd4803e7f285', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db4e4a2-df62-4028-a4de-6a87da53fdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:51 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Volume volume-a27db357-b40d-4db2-bd33-fd4803e7f285 (a27db357-b40d-4db2-bd33-fd4803e7f285): created successfully Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db4e4a2-df62-4028-a4de-6a87da53fdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Flow 'volume_create_manager' (fe268537-22b8-49ae-80c6-728d43bf5c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:51 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-7d84248a-865a-434c-9db0-293d8bc76333 tempest-VolumesActionsTest-48704033 None] Created volume successfully. Apr 07 06:08:51 devstack sudo[85554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b Apr 07 06:08:51 devstack sudo[85554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Flow 'volume_create_manager' (b262b809-798d-4c1f-bda1-45b8d2dde3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bfbb17e-a0fc-4fab-85be-8661f2686bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bfbb17e-a0fc-4fab-85be-8661f2686bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1845018788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb64765-9f42-419e-af1e-a39a37ad58b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4d5caf6567cd4d2392dfa27e680956de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:51Z,use_quota=True,user_id='670df96bb60140ef89b78d4e82e18b9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f5e5f0-04e2-4b00-8fcf-bd67619b2b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f5e5f0-04e2-4b00-8fcf-bd67619b2b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b612070-c5bd-4e64-a32e-0c4a8aafa33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b612070-c5bd-4e64-a32e-0c4a8aafa33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdb64765-9f42-419e-af1e-a39a37ad58b9', 'volume_name': 'volume-bdb64765-9f42-419e-af1e-a39a37ad58b9', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd64941b-2aee-4827-a210-8ea974bb6264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd64941b-2aee-4827-a210-8ea974bb6264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141c249d-9924-40b1-aa6c-c2f6650a0a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:51 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Volume bdb64765-9f42-419e-af1e-a39a37ad58b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdb64765-9f42-419e-af1e-a39a37ad58b9', 'volume_size': 1} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1845018788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb64765-9f42-419e-af1e-a39a37ad58b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4d5caf6567cd4d2392dfa27e680956de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:51Z,use_quota=True,user_id='670df96bb60140ef89b78d4e82e18b9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Creating volume bdb64765-9f42-419e-af1e-a39a37ad58b9 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:08:51 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bdb64765-9f42-419e-af1e-a39a37ad58b9 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:51 devstack sudo[85556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bdb64765-9f42-419e-af1e-a39a37ad58b9 1073741824 Apr 07 06:08:51 devstack sudo[85556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG oslo_service.periodic_task [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82475) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:51 devstack sudo[85554]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b" returned: 0 in 0.733s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:51 devstack sudo[85560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:08:51 devstack sudo[85560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:51 devstack sudo[85561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b Apr 07 06:08:51 devstack sudo[85561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:52 devstack sudo[85556]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bdb64765-9f42-419e-af1e-a39a37ad58b9 1073741824" returned: 0 in 1.026s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:52 devstack sudo[85560]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.792s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:52 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:08:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bdb64765-9f42-419e-af1e-a39a37ad58b9 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:52 devstack sudo[85571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bdb64765-9f42-419e-af1e-a39a37ad58b9 Apr 07 06:08:52 devstack sudo[85571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:52 devstack sudo[85561]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b" returned: 1 in 0.898s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b' failed. Not Retrying. {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:08:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:52 devstack sudo[85573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b Apr 07 06:08:52 devstack sudo[85573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:53 devstack sudo[85571]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bdb64765-9f42-419e-af1e-a39a37ad58b9" returned: 0 in 0.669s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:08:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141c249d-9924-40b1-aa6c-c2f6650a0a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb64765-9f42-419e-af1e-a39a37ad58b9', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee794a0c-3773-4f5f-ba57-05dd06ea15ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:53 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Volume volume-bdb64765-9f42-419e-af1e-a39a37ad58b9 (bdb64765-9f42-419e-af1e-a39a37ad58b9): created successfully Apr 07 06:08:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee794a0c-3773-4f5f-ba57-05dd06ea15ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Flow 'volume_create_manager' (b262b809-798d-4c1f-bda1-45b8d2dde3bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:53 devstack sudo[85573]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-311d7112-68b9-446c-8988-526825b6206b" returned: 0 in 0.652s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:53 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-20b85d5a-2b3f-4dac-a3e0-d734a25d4c3e tempest-VolumesTestJSON-114480708 None] Created volume successfully. Apr 07 06:08:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "cinder-quobyte-311d7112-68b9-446c-8988-526825b6206b" released by "delete_volume" :: held 2.350s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:53 devstack cinder-volume[82475]: DEBUG cinder.quota [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Created reservations ['b5cd85ab-fa0e-47e5-aafb-d2f524956fd7', 'a008e5ef-ca92-4919-9e4a-4807ebe77393', '878b9e7a-47c0-483d-b614-6225b686c9fe', 'e81a92cf-a6a5-480f-af06-887bffba17bd'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:08:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:53 devstack sudo[85580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:08:53 devstack sudo[85580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Flow 'volume_create_manager' (a3ad532f-b419-4a5b-8575-a849afb7f3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfd34f1-96db-49ab-892d-6858e312a181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfd34f1-96db-49ab-892d-6858e312a181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-704582759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38451401-b187-4287-8142-7769b32abb6d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4d5caf6567cd4d2392dfa27e680956de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:54Z,use_quota=True,user_id='670df96bb60140ef89b78d4e82e18b9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673fc71d-700f-4ccb-ba35-c58cdf316461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673fc71d-700f-4ccb-ba35-c58cdf316461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e4bfd0-57dd-4e80-9adb-96d5ce688727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e4bfd0-57dd-4e80-9adb-96d5ce688727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38451401-b187-4287-8142-7769b32abb6d', 'volume_name': 'volume-38451401-b187-4287-8142-7769b32abb6d', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a85aa5e-1102-47dc-a959-6577995a4db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a85aa5e-1102-47dc-a959-6577995a4db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f5f751-2369-4704-946d-126abf25a5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:54 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Volume 38451401-b187-4287-8142-7769b32abb6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38451401-b187-4287-8142-7769b32abb6d', 'volume_size': 1} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-704582759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38451401-b187-4287-8142-7769b32abb6d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4d5caf6567cd4d2392dfa27e680956de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:54Z,use_quota=True,user_id='670df96bb60140ef89b78d4e82e18b9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Creating volume 38451401-b187-4287-8142-7769b32abb6d {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:08:54 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-38451401-b187-4287-8142-7769b32abb6d 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:54 devstack sudo[85580]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 1.064s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG cinder.manager [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:08:54 devstack cinder-volume[82475]: INFO cinder.volume.manager [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Deleted volume successfully. Apr 07 06:08:54 devstack sudo[85584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-38451401-b187-4287-8142-7769b32abb6d 1073741824 Apr 07 06:08:54 devstack sudo[85584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-832e974d-22a6-41df-967a-844148916634 req-42cd3c8c-91fe-4ebe-a18c-6cbd41c42d78 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "cinder-311d7112-68b9-446c-8988-526825b6206b-delete_volume" released by "delete_volume" :: held 3.652s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:08:55 devstack sudo[85584]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-38451401-b187-4287-8142-7769b32abb6d 1073741824" returned: 0 in 0.839s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-38451401-b187-4287-8142-7769b32abb6d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:55 devstack sudo[85591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-38451401-b187-4287-8142-7769b32abb6d Apr 07 06:08:55 devstack sudo[85591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:56 devstack sudo[85591]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-38451401-b187-4287-8142-7769b32abb6d" returned: 0 in 0.624s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:56 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:08:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f5f751-2369-4704-946d-126abf25a5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38451401-b187-4287-8142-7769b32abb6d', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345630ac-c538-4d90-a849-441435b558d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:56 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Volume volume-38451401-b187-4287-8142-7769b32abb6d (38451401-b187-4287-8142-7769b32abb6d): created successfully Apr 07 06:08:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345630ac-c538-4d90-a849-441435b558d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Flow 'volume_create_manager' (a3ad532f-b419-4a5b-8575-a849afb7f3c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:56 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-110fd137-ae4c-4627-8b55-e52b13046b7b tempest-VolumesTestJSON-114480708 None] Created volume successfully. Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Flow 'volume_create_manager' (e6742527-23fd-4a87-960d-949547bd8fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5f425a-1b8b-4eb7-94e0-05d9a388015d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5f425a-1b8b-4eb7-94e0-05d9a388015d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1729417221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d52c75-6a57-48b9-b67a-c1230dfa5f02,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4d5caf6567cd4d2392dfa27e680956de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:57Z,use_quota=True,user_id='670df96bb60140ef89b78d4e82e18b9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae396d97-e414-43bf-9ab5-cdaa2b9a5b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae396d97-e414-43bf-9ab5-cdaa2b9a5b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0973a96-2812-4a7c-8920-1b01b68e9260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0973a96-2812-4a7c-8920-1b01b68e9260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25d52c75-6a57-48b9-b67a-c1230dfa5f02', 'volume_name': 'volume-25d52c75-6a57-48b9-b67a-c1230dfa5f02', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3055f736-b629-4aa3-9f28-f76f56fe43e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3055f736-b629-4aa3-9f28-f76f56fe43e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315ba728-67a3-4d35-ac02-1169e9b224e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:57 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Volume 25d52c75-6a57-48b9-b67a-c1230dfa5f02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25d52c75-6a57-48b9-b67a-c1230dfa5f02', 'volume_size': 1} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1729417221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d52c75-6a57-48b9-b67a-c1230dfa5f02,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4d5caf6567cd4d2392dfa27e680956de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:08:57Z,use_quota=True,user_id='670df96bb60140ef89b78d4e82e18b9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Creating volume 25d52c75-6a57-48b9-b67a-c1230dfa5f02 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:08:57 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:08:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25d52c75-6a57-48b9-b67a-c1230dfa5f02 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:57 devstack sudo[85658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25d52c75-6a57-48b9-b67a-c1230dfa5f02 1073741824 Apr 07 06:08:57 devstack sudo[85658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:58 devstack sudo[85658]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25d52c75-6a57-48b9-b67a-c1230dfa5f02 1073741824" returned: 0 in 0.894s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25d52c75-6a57-48b9-b67a-c1230dfa5f02 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:08:58 devstack sudo[85665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25d52c75-6a57-48b9-b67a-c1230dfa5f02 Apr 07 06:08:58 devstack sudo[85665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:08:59 devstack sudo[85665]: pam_unix(sudo:session): session closed for user root Apr 07 06:08:59 devstack cinder-volume[82475]: INFO cinder.volume.manager [req-2eb03ad5-ecb0-496c-a661-2a6fb771909e req-8017a66d-ae4a-42be-9a2d-db9e3b02cb7b tempest-DeleteServersTestJSON-859674876 None] Terminate volume connection completed successfully. Apr 07 06:08:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-2eb03ad5-ecb0-496c-a661-2a6fb771909e req-8017a66d-ae4a-42be-9a2d-db9e3b02cb7b tempest-DeleteServersTestJSON-859674876 None] Deleting attachment 00ece667-f9de-4e39-9540-af591184f9c5. {{(pid=82475) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 07 06:08:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25d52c75-6a57-48b9-b67a-c1230dfa5f02" returned: 0 in 0.702s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:08:59 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:08:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:08:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315ba728-67a3-4d35-ac02-1169e9b224e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25d52c75-6a57-48b9-b67a-c1230dfa5f02', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9b27b0-214a-4728-8376-78d0f10366d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:08:59 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Volume volume-25d52c75-6a57-48b9-b67a-c1230dfa5f02 (25d52c75-6a57-48b9-b67a-c1230dfa5f02): created successfully Apr 07 06:08:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9b27b0-214a-4728-8376-78d0f10366d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:08:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Flow 'volume_create_manager' (e6742527-23fd-4a87-960d-949547bd8fa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:08:59 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-1f98915c-e576-4408-9d16-b6397e37cfbc tempest-VolumesTestJSON-114480708 None] Created volume successfully. Apr 07 06:09:00 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] Acquiring lock "cinder-25d52c75-6a57-48b9-b67a-c1230dfa5f02-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:00 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] Lock "cinder-25d52c75-6a57-48b9-b67a-c1230dfa5f02-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:00 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] Acquiring lock "cinder-quobyte-25d52c75-6a57-48b9-b67a-c1230dfa5f02" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:00 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] Lock "cinder-quobyte-25d52c75-6a57-48b9-b67a-c1230dfa5f02" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:00 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c55001-794c-48dc-9a42-349fb7bf5ed6]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25d52c75-6a57-48b9-b67a-c1230dfa5f02 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:00 devstack sudo[85683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25d52c75-6a57-48b9-b67a-c1230dfa5f02 Apr 07 06:09:00 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:01 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25d52c75-6a57-48b9-b67a-c1230dfa5f02" returned: 0 in 0.569s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25d52c75-6a57-48b9-b67a-c1230dfa5f02 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:01 devstack sudo[85690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25d52c75-6a57-48b9-b67a-c1230dfa5f02 Apr 07 06:09:01 devstack sudo[85690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:01 devstack sudo[85690]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25d52c75-6a57-48b9-b67a-c1230dfa5f02" returned: 0 in 0.625s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] Lock "cinder-quobyte-25d52c75-6a57-48b9-b67a-c1230dfa5f02" released by "delete_volume" :: held 1.239s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:01 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] Created reservations ['c86d6f02-8ac1-4292-a5f2-b9394744ef13', 'f9d01886-b518-4596-b66c-08b1c0a03f93', 'da1af00b-3488-4253-98b1-b0b0cf78bb77', 'f998d63a-8c97-4729-aab4-f809b5f3a7df'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:01 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:01 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:01 devstack sudo[85694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:09:01 devstack sudo[85694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:02 devstack sudo[85694]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.499s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:02 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:09:02 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] Deleted volume successfully. Apr 07 06:09:02 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-621fb7c2-9d1e-4081-bdd9-d290e203e1a5 tempest-VolumesTestJSON-114480708 None] Lock "cinder-25d52c75-6a57-48b9-b67a-c1230dfa5f02-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:02 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] Acquiring lock "cinder-38451401-b187-4287-8142-7769b32abb6d-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:02 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] Lock "cinder-38451401-b187-4287-8142-7769b32abb6d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:02 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] Acquiring lock "cinder-quobyte-38451401-b187-4287-8142-7769b32abb6d" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:02 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] Lock "cinder-quobyte-38451401-b187-4287-8142-7769b32abb6d" acquired by "delete_volume" :: waited 0.023s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:02 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae343c8-3ff5-4ed4-81c3-a15b8441a91e]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-38451401-b187-4287-8142-7769b32abb6d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:02 devstack sudo[85706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-38451401-b187-4287-8142-7769b32abb6d Apr 07 06:09:02 devstack sudo[85706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] Acquiring lock "cinder-039373a0-243b-42f1-b3f8-ce3bc83280e2-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:03 devstack sudo[85706]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] Lock "cinder-039373a0-243b-42f1-b3f8-ce3bc83280e2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-38451401-b187-4287-8142-7769b32abb6d" returned: 0 in 0.721s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-38451401-b187-4287-8142-7769b32abb6d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:03 devstack sudo[85741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-38451401-b187-4287-8142-7769b32abb6d Apr 07 06:09:03 devstack sudo[85741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] Acquiring lock "cinder-quobyte-039373a0-243b-42f1-b3f8-ce3bc83280e2" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] Lock "cinder-quobyte-039373a0-243b-42f1-b3f8-ce3bc83280e2" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:03 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f81e4a-f981-46b8-bd8b-b4ab0414a774]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-039373a0-243b-42f1-b3f8-ce3bc83280e2 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:03 devstack sudo[85743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-039373a0-243b-42f1-b3f8-ce3bc83280e2 Apr 07 06:09:03 devstack sudo[85743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:04 devstack sudo[85741]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-38451401-b187-4287-8142-7769b32abb6d" returned: 0 in 0.849s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] Lock "cinder-quobyte-38451401-b187-4287-8142-7769b32abb6d" released by "delete_volume" :: held 1.673s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:04 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] Created reservations ['a39a4a3c-34ef-4b9d-b7e3-579758ea70b0', '8f56eb3e-3b73-4932-9506-c35a51ea9c96', '4d4207e5-5388-4f03-aee4-bf220ea04913', '3028a7f6-fefb-44b5-b2d0-ab4846940d1d'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:04 devstack sudo[85743]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-039373a0-243b-42f1-b3f8-ce3bc83280e2" returned: 0 in 0.987s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-039373a0-243b-42f1-b3f8-ce3bc83280e2 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:04 devstack sudo[85774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-039373a0-243b-42f1-b3f8-ce3bc83280e2 Apr 07 06:09:04 devstack sudo[85774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:04 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:04 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:04 devstack sudo[85776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:09:04 devstack sudo[85776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] Acquiring lock "cinder-bdb64765-9f42-419e-af1e-a39a37ad58b9-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] Lock "cinder-bdb64765-9f42-419e-af1e-a39a37ad58b9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] Acquiring lock "cinder-quobyte-bdb64765-9f42-419e-af1e-a39a37ad58b9" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] Lock "cinder-quobyte-bdb64765-9f42-419e-af1e-a39a37ad58b9" acquired by "delete_volume" :: waited 0.017s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:05 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdccce10-29e7-4414-a206-991c9770e498]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bdb64765-9f42-419e-af1e-a39a37ad58b9 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:05 devstack sudo[85785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bdb64765-9f42-419e-af1e-a39a37ad58b9 Apr 07 06:09:05 devstack sudo[85785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:05 devstack sudo[85776]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.908s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:05 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:09:05 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] Deleted volume successfully. Apr 07 06:09:05 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-13d6a647-5e44-4dae-9b5c-123ade0ee817 tempest-VolumesTestJSON-114480708 None] Lock "cinder-38451401-b187-4287-8142-7769b32abb6d-delete_volume" released by "delete_volume" :: held 2.978s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:05 devstack sudo[85774]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-039373a0-243b-42f1-b3f8-ce3bc83280e2" returned: 0 in 1.060s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:05 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] Lock "cinder-quobyte-039373a0-243b-42f1-b3f8-ce3bc83280e2" released by "delete_volume" :: held 2.074s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:05 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] Created reservations ['0cff6256-057f-43af-b42e-539f453f7142', '25def410-e8af-48da-acae-88b90ba2ec15', '168f9da1-1059-4c84-9b76-7bcf6ee52230', 'bbfa9ff3-7111-41af-8dcb-e1eb15c22461'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:05 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:05 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:05 devstack sudo[85795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:09:05 devstack sudo[85795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:05 devstack sudo[85785]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bdb64765-9f42-419e-af1e-a39a37ad58b9" returned: 0 in 0.896s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bdb64765-9f42-419e-af1e-a39a37ad58b9 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:05 devstack sudo[85797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bdb64765-9f42-419e-af1e-a39a37ad58b9 Apr 07 06:09:05 devstack sudo[85797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:06 devstack cinder-volume[82475]: INFO cinder.volume.manager [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-5be7073d-2694-4b4f-ab07-e5862ae41d6c tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Terminate volume connection completed successfully. Apr 07 06:09:06 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-5be7073d-2694-4b4f-ab07-e5862ae41d6c tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Deleting attachment fbc37d8c-e4ba-4bcd-81ba-cf7007964721. {{(pid=82475) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 07 06:09:06 devstack sudo[85795]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.757s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:06 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:09:06 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] Deleted volume successfully. Apr 07 06:09:06 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2a5eded3-c24e-43b3-acd7-3ab29dd8a4eb tempest-DeleteServersTestJSON-859674876 None] Lock "cinder-039373a0-243b-42f1-b3f8-ce3bc83280e2-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:06 devstack sudo[85797]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bdb64765-9f42-419e-af1e-a39a37ad58b9" returned: 0 in 0.880s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:06 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] Lock "cinder-quobyte-bdb64765-9f42-419e-af1e-a39a37ad58b9" released by "delete_volume" :: held 1.826s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:06 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] Created reservations ['466ed681-d9ea-492d-bc86-b7735e23b4c5', 'e72d5f86-8009-4e3f-bb4c-b83a0a0a81cb', '1e87aad3-e73f-49da-923c-954b5035e436', 'd97b719d-a2f4-4a97-a8c0-049902ac8353'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:06 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:06 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:06 devstack sudo[85801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:09:06 devstack sudo[85801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:06 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Acquiring lock "cinder-d9976ab6-de46-47dc-a371-bc9b746d2f81-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "cinder-d9976ab6-de46-47dc-a371-bc9b746d2f81-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Acquiring lock "cinder-quobyte-d9976ab6-de46-47dc-a371-bc9b746d2f81" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "cinder-quobyte-d9976ab6-de46-47dc-a371-bc9b746d2f81" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:07 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[871cf40a-f544-42f1-ae95-dd75c28ef222]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d9976ab6-de46-47dc-a371-bc9b746d2f81 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:07 devstack sudo[85803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d9976ab6-de46-47dc-a371-bc9b746d2f81 Apr 07 06:09:07 devstack sudo[85803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:07 devstack sudo[85801]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 1.053s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:07 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:09:08 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] Deleted volume successfully. Apr 07 06:09:08 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:UPDATE=111,cinder:DELETE=11,cinder:SELECT=89,cinder:INSERT=26 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:09:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-61ead28e-4f7a-4218-9cc7-1aca488ce69d tempest-VolumesTestJSON-114480708 None] Lock "cinder-bdb64765-9f42-419e-af1e-a39a37ad58b9-delete_volume" released by "delete_volume" :: held 3.154s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:08 devstack sudo[85803]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d9976ab6-de46-47dc-a371-bc9b746d2f81" returned: 0 in 1.180s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d9976ab6-de46-47dc-a371-bc9b746d2f81 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:08 devstack sudo[85824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d9976ab6-de46-47dc-a371-bc9b746d2f81 Apr 07 06:09:08 devstack sudo[85824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-40082a27-e09f-4e24-a682-2f1668dd4011 tempest-VolumesActionsTest-48704033 None] Acquiring lock "cinder-a27db357-b40d-4db2-bd33-fd4803e7f285" by "attach_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-40082a27-e09f-4e24-a682-2f1668dd4011 tempest-VolumesActionsTest-48704033 None] Lock "cinder-a27db357-b40d-4db2-bd33-fd4803e7f285" acquired by "attach_volume" :: waited 0.018s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:08 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:UPDATE=99,cinder:SELECT=83,cinder:INSERT=31,cinder:DELETE=8 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:09:08 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-40082a27-e09f-4e24-a682-2f1668dd4011 tempest-VolumesActionsTest-48704033 None] Attaching volume a27db357-b40d-4db2-bd33-fd4803e7f285 to instance e8a03111-e099-4e05-a47c-c3bfe0f61448 at mountpoint /dev/vdb on host None. Apr 07 06:09:08 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-40082a27-e09f-4e24-a682-2f1668dd4011 tempest-VolumesActionsTest-48704033 None] Attach volume completed successfully. Apr 07 06:09:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-40082a27-e09f-4e24-a682-2f1668dd4011 tempest-VolumesActionsTest-48704033 None] Lock "cinder-a27db357-b40d-4db2-bd33-fd4803e7f285" released by "attach_volume" :: held 0.152s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:09 devstack sudo[85824]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d9976ab6-de46-47dc-a371-bc9b746d2f81" returned: 0 in 0.785s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "cinder-quobyte-d9976ab6-de46-47dc-a371-bc9b746d2f81" released by "delete_volume" :: held 2.026s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:09 devstack cinder-volume[82475]: DEBUG cinder.quota [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Created reservations ['6e13ba7d-d438-42e4-97a5-1b9ab2e0a82f', 'ccffdf67-b555-436e-934e-ce17d7bd2888', 'f39cc1ae-8017-4200-b065-262d47ba0b78', '265beac3-9aa8-4ff4-b262-fd7c00bc0c1d'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:09 devstack sudo[85828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:09:09 devstack sudo[85828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8c0f596f-4441-459a-b534-b5807ce322da tempest-VolumesActionsTest-48704033 None] Acquiring lock "cinder-a27db357-b40d-4db2-bd33-fd4803e7f285-detach_volume" by "detach_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8c0f596f-4441-459a-b534-b5807ce322da tempest-VolumesActionsTest-48704033 None] Lock "cinder-a27db357-b40d-4db2-bd33-fd4803e7f285-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:09 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-8c0f596f-4441-459a-b534-b5807ce322da tempest-VolumesActionsTest-48704033 None] Detaching volume a27db357-b40d-4db2-bd33-fd4803e7f285 from instance e8a03111-e099-4e05-a47c-c3bfe0f61448. Apr 07 06:09:09 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-8c0f596f-4441-459a-b534-b5807ce322da tempest-VolumesActionsTest-48704033 None] Detach volume completed successfully. Apr 07 06:09:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8c0f596f-4441-459a-b534-b5807ce322da tempest-VolumesActionsTest-48704033 None] Lock "cinder-a27db357-b40d-4db2-bd33-fd4803e7f285-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:09 devstack sudo[85828]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.651s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:09 devstack cinder-volume[82475]: DEBUG cinder.manager [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:09:09 devstack cinder-volume[82475]: INFO cinder.volume.manager [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Deleted volume successfully. Apr 07 06:09:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-810bebf1-f6f1-4398-91be-ef6503ca21f1 req-6ca86fbb-51b4-4dfe-be01-aaa8d7eae3c3 tempest-ServerBootFromVolumeStableRescueTest-1774064929 None] Lock "cinder-d9976ab6-de46-47dc-a371-bc9b746d2f81-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:12 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-66efb4ef-920d-40a7-9953-632672aa4f74 tempest-GroupSnapshotsTest-786210802 None] Group tempest-GroupSnapshotsTest-Group-1456037287: creating Apr 07 06:09:12 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-66efb4ef-920d-40a7-9953-632672aa4f74 tempest-GroupSnapshotsTest-786210802 None] Group tempest-GroupSnapshotsTest-Group-1456037287: created successfully Apr 07 06:09:12 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-66efb4ef-920d-40a7-9953-632672aa4f74 tempest-GroupSnapshotsTest-786210802 None] Create group completed successfully. Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Flow 'volume_create_manager' (6d853929-eaf1-4005-9862-bb217db55d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b10a99-40bd-449a-ac4c-5957b435f8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b10a99-40bd-449a-ac4c-5957b435f8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-117081125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=094d30bd-5df1-4bca-94fc-2a6783cf73c5,host='devstack@QuobyteHD#QuobyteHD',id=4348c05a-0b53-4fbd-b687-b2fd212cac19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d096b43038f44349eadd58a7d92c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:13Z,use_quota=True,user_id='a08c2d4f6eaf47adad5dac1cc3efdf1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87ff5657-e986-4ea2-b9bc-0902d677df20),volume_type_id=87ff5657-e986-4ea2-b9bc-0902d677df20)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4578d8e6-1d05-46b3-a930-638a4aca0732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4578d8e6-1d05-46b3-a930-638a4aca0732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cab8765-f56b-413a-ad33-58ab107b27b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cab8765-f56b-413a-ad33-58ab107b27b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4348c05a-0b53-4fbd-b687-b2fd212cac19', 'volume_name': 'volume-4348c05a-0b53-4fbd-b687-b2fd212cac19', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43379fe2-89bf-4935-9ace-8ef01b4365e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43379fe2-89bf-4935-9ace-8ef01b4365e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (293f5c26-ead4-4a46-9200-35dc9375b6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:13 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Volume 4348c05a-0b53-4fbd-b687-b2fd212cac19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4348c05a-0b53-4fbd-b687-b2fd212cac19', 'volume_size': 1} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=094d30bd-5df1-4bca-94fc-2a6783cf73c5,created_at=2026-04-07T04:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-117081125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=094d30bd-5df1-4bca-94fc-2a6783cf73c5,host='devstack@QuobyteHD#QuobyteHD',id=4348c05a-0b53-4fbd-b687-b2fd212cac19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d096b43038f44349eadd58a7d92c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:13Z,use_quota=True,user_id='a08c2d4f6eaf47adad5dac1cc3efdf1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87ff5657-e986-4ea2-b9bc-0902d677df20),volume_type_id=87ff5657-e986-4ea2-b9bc-0902d677df20)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Creating volume 4348c05a-0b53-4fbd-b687-b2fd212cac19 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:09:13 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:09:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:13 devstack sudo[85890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 1073741824 Apr 07 06:09:13 devstack sudo[85890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:14 devstack sudo[85890]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 1073741824" returned: 0 in 0.755s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:14 devstack sudo[85896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 Apr 07 06:09:14 devstack sudo[85896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:14 devstack sudo[85896]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19" returned: 0 in 0.517s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:14 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:09:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:14 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (293f5c26-ead4-4a46-9200-35dc9375b6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4348c05a-0b53-4fbd-b687-b2fd212cac19', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:14 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6792db88-edb0-431d-890e-e446c5417b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:14 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Volume volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 (4348c05a-0b53-4fbd-b687-b2fd212cac19): created successfully Apr 07 06:09:14 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6792db88-edb0-431d-890e-e446c5417b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:14 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Flow 'volume_create_manager' (6d853929-eaf1-4005-9862-bb217db55d6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:14 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-8232adc7-8685-412a-b760-9be7ae5e122d tempest-GroupSnapshotsTest-786210802 None] Created volume successfully. Apr 07 06:09:15 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-6929ccdb-aa2a-483a-b941-be78523285c9 tempest-GroupSnapshotsV319Test-294580359 None] Group tempest-GroupSnapshotsV319Test-Group-49303311: creating Apr 07 06:09:15 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-6929ccdb-aa2a-483a-b941-be78523285c9 tempest-GroupSnapshotsV319Test-294580359 None] Group tempest-GroupSnapshotsV319Test-Group-49303311: created successfully Apr 07 06:09:15 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-6929ccdb-aa2a-483a-b941-be78523285c9 tempest-GroupSnapshotsV319Test-294580359 None] Create group completed successfully. Apr 07 06:09:15 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] GroupSnapshot 4b2304d4-2a27-44bc-b32c-7e0456b2bce1: creating. Apr 07 06:09:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] Group snapshot 4b2304d4-2a27-44bc-b32c-7e0456b2bce1: creating. {{(pid=82475) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 07 06:09:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] Creating offline snapshot 41450267-c2a3-4f56-8134-cb9e5060b2bd of volume 4348c05a-0b53-4fbd-b687-b2fd212cac19 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:09:15 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f5b741-abd7-4ae9-b1bd-38ed0566a0c2]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:16 devstack sudo[85899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 Apr 07 06:09:16 devstack sudo[85899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:16 devstack sudo[85899]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19" returned: 0 in 0.626s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:16 devstack sudo[85938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd 1G Apr 07 06:09:16 devstack sudo[85938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:16 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:09:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Flow 'volume_create_manager' (1b65e102-2cef-4f42-af91-abf5fbff6392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9dccbc-8859-43e7-8d97-f946fc71072b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9dccbc-8859-43e7-8d97-f946fc71072b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1816921156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5bc5619e-f929-47ec-8cc1-59d004268f20,host='devstack@QuobyteHD#QuobyteHD',id=e1e8bd14-7305-4652-aac3-f32f555c33b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ead5c16a3943d4a1927187c2857c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:17Z,use_quota=True,user_id='0ba96b097f5c4701b656dccbbba6c591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79613e42-58be-4083-90bd-4a7e0148e2b7),volume_type_id=79613e42-58be-4083-90bd-4a7e0148e2b7)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c98321-1a3f-4f18-b0c6-790ccab5aa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c98321-1a3f-4f18-b0c6-790ccab5aa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10146ec-7a90-435c-9867-b704427f799e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10146ec-7a90-435c-9867-b704427f799e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e8bd14-7305-4652-aac3-f32f555c33b5', 'volume_name': 'volume-e1e8bd14-7305-4652-aac3-f32f555c33b5', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ccf2db-59f0-44b6-bbde-bb4941e57fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ccf2db-59f0-44b6-bbde-bb4941e57fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c6364e-241b-4614-a42b-8fbcc3018392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:16 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Volume e1e8bd14-7305-4652-aac3-f32f555c33b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e8bd14-7305-4652-aac3-f32f555c33b5', 'volume_size': 1} Apr 07 06:09:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:17 devstack sudo[85938]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd 1G" returned: 0 in 0.622s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:17 devstack sudo[85944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd Apr 07 06:09:17 devstack sudo[85944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:17 devstack sudo[85944]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd" returned: 0 in 0.518s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:17 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:09:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:17 devstack sudo[85951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd Apr 07 06:09:17 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:18 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd" returned: 0 in 0.524s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:18 devstack sudo[85955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.info Apr 07 06:09:18 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:18 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.info" returned: 0 in 0.498s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:18 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.info is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:09:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:18 devstack sudo[85958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.info Apr 07 06:09:18 devstack sudo[85958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:19 devstack sudo[85958]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.info" returned: 0 in 0.486s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.338s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.542s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:19 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5bc5619e-f929-47ec-8cc1-59d004268f20,created_at=2026-04-07T04:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1816921156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5bc5619e-f929-47ec-8cc1-59d004268f20,host='devstack@QuobyteHD#QuobyteHD',id=e1e8bd14-7305-4652-aac3-f32f555c33b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ead5c16a3943d4a1927187c2857c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:17Z,use_quota=True,user_id='0ba96b097f5c4701b656dccbbba6c591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79613e42-58be-4083-90bd-4a7e0148e2b7),volume_type_id=79613e42-58be-4083-90bd-4a7e0148e2b7)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:09:19 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Creating volume e1e8bd14-7305-4652-aac3-f32f555c33b5 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:09:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:19 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:19 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:19 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:09:19 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:09:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:19 devstack sudo[85963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5 1073741824 Apr 07 06:09:19 devstack sudo[85963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:19 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-6d6c49d5-9da1-408b-b783-b7e015dacc6b tempest-GroupSnapshotsTest-786210802 None] group_snapshot 4b2304d4-2a27-44bc-b32c-7e0456b2bce1: created successfully Apr 07 06:09:19 devstack sudo[85963]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5 1073741824" returned: 0 in 0.607s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:19 devstack sudo[85969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5 Apr 07 06:09:19 devstack sudo[85969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:20 devstack sudo[85969]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5" returned: 0 in 0.612s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:09:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c6364e-241b-4614-a42b-8fbcc3018392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e8bd14-7305-4652-aac3-f32f555c33b5', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee44abf-fb7d-464b-a58b-958fa1191afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:20 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Volume volume-e1e8bd14-7305-4652-aac3-f32f555c33b5 (e1e8bd14-7305-4652-aac3-f32f555c33b5): created successfully Apr 07 06:09:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee44abf-fb7d-464b-a58b-958fa1191afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Flow 'volume_create_manager' (1b65e102-2cef-4f42-af91-abf5fbff6392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:20 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-751f80b0-70ee-4d78-ac21-d7eb68fce650 tempest-GroupSnapshotsV319Test-294580359 None] Created volume successfully. Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "cinder-quobyte-41450267-c2a3-4f56-8134-cb9e5060b2bd-29166f92-7b01-446c-9cc3-c611788fabaf" by "_create_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-41450267-c2a3-4f56-8134-cb9e5060b2bd-29166f92-7b01-446c-9cc3-c611788fabaf" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Creating volume 29166f92-7b01-446c-9cc3-c611788fabaf from snapshot 41450267-c2a3-4f56-8134-cb9e5060b2bd {{(pid=82475) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "cinder-quobyte-29166f92-7b01-446c-9cc3-c611788fabaf" by "_copy_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:21 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] GroupSnapshot 8b5851f3-0a31-4f34-9cd5-5af324bab192: creating. Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-29166f92-7b01-446c-9cc3-c611788fabaf" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] snapshot: 41450267-c2a3-4f56-8134-cb9e5060b2bd, volume: 29166f92-7b01-446c-9cc3-c611788fabaf, {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] Group snapshot 8b5851f3-0a31-4f34-9cd5-5af324bab192: creating. {{(pid=82475) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2babeb-614a-4daa-9cd8-595563fd47b8]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:21 devstack sudo[85973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd Apr 07 06:09:21 devstack sudo[85973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:22 devstack sudo[85973]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd" returned: 0 in 0.671s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4348c05a-0b53-4fbd-b687-b2fd212cac19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:09:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] will copy from snapshot at /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:09:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Creating direct copy from snapshot {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:09:22 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[be463177-f690-43f3-9c1d-70cae47abb1d]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:22 devstack sudo[85978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 Apr 07 06:09:22 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:22 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19" returned: 0 in 0.744s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:22 devstack cinder-volume[82475]: DEBUG cinder.utils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Path /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-29166f92-7b01-446c-9cc3-c611788fabaf not found in is_blk_device check {{(pid=82475) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:09:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-29166f92-7b01-446c-9cc3-c611788fabaf {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:22 devstack sudo[85983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-29166f92-7b01-446c-9cc3-c611788fabaf Apr 07 06:09:22 devstack sudo[85983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:24 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:09:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Flow 'volume_create_manager' (c215b13e-ca1b-4e6e-b843-36694bda155f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739b3e63-40f7-439f-9dbf-ebc7ccee9ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739b3e63-40f7-439f-9dbf-ebc7ccee9ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-524502686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12cea721-8156-42be-9de5-70a4134d2101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be74749488724dc9b02f5a944d48b1bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:25Z,use_quota=True,user_id='a3e3c65a82a942b8b941d7aae5e144d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4c5359-ecf4-42c1-84f3-0ed28509cace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4c5359-ecf4-42c1-84f3-0ed28509cace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8a37b4-a4f2-4352-86f0-0ed0749df850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8a37b4-a4f2-4352-86f0-0ed0749df850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12cea721-8156-42be-9de5-70a4134d2101', 'volume_name': 'volume-12cea721-8156-42be-9de5-70a4134d2101', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6df22ec-5c62-46ef-98d6-fe3eebb5db1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6df22ec-5c62-46ef-98d6-fe3eebb5db1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599235da-49c9-43c4-b7f9-8b9004ba40af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:25 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Volume 12cea721-8156-42be-9de5-70a4134d2101: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12cea721-8156-42be-9de5-70a4134d2101', 'volume_size': 1} Apr 07 06:09:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:25 devstack sudo[85983]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-29166f92-7b01-446c-9cc3-c611788fabaf" returned: 0 in 3.074s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:25 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a494c7-3a52-4589-924e-a71c7506e498]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:26 devstack sudo[86011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 Apr 07 06:09:26 devstack sudo[86011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:26 devstack sudo[86011]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19" returned: 0 in 0.694s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:26 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Image conversion details: src /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19, size 1024.00 MB, duration 3.08 sec, destination /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-29166f92-7b01-446c-9cc3-c611788fabaf {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:09:26 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Converted 1024.00 MB image at 332.98 MB/s Apr 07 06:09:26 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-29166f92-7b01-446c-9cc3-c611788fabaf is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:09:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-29166f92-7b01-446c-9cc3-c611788fabaf {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:26 devstack sudo[86016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-29166f92-7b01-446c-9cc3-c611788fabaf Apr 07 06:09:26 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:27 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-29166f92-7b01-446c-9cc3-c611788fabaf" returned: 0 in 0.416s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-29166f92-7b01-446c-9cc3-c611788fabaf" released by "_copy_volume_from_snapshot" :: held 5.697s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-41450267-c2a3-4f56-8134-cb9e5060b2bd-29166f92-7b01-446c-9cc3-c611788fabaf" released by "_create_volume_from_snapshot" :: held 5.734s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.744s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.649s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:27 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] Creating offline snapshot db4fc5a6-10fc-46bd-81f6-feec92f7a150 of volume e1e8bd14-7305-4652-aac3-f32f555c33b5 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:09:27 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8684820-0a50-4f5f-b0ce-9475f07a3f68]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:27 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-f4213f2d-c8c7-4573-ab08-905d88d415c6 tempest-GroupSnapshotsTest-786210802 None] Create group from source-snapshot-4b2304d4-2a27-44bc-b32c-7e0456b2bce1 completed successfully. Apr 07 06:09:27 devstack sudo[86019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5 Apr 07 06:09:27 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:27 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5" returned: 0 in 0.642s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "cinder-quobyte-29166f92-7b01-446c-9cc3-c611788fabaf" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-29166f92-7b01-446c-9cc3-c611788fabaf" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:27 devstack sudo[86027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150 1G Apr 07 06:09:27 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:27 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c802fe-8456-4600-bcd5-c74d53073d72]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-29166f92-7b01-446c-9cc3-c611788fabaf {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:27 devstack sudo[86029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-29166f92-7b01-446c-9cc3-c611788fabaf Apr 07 06:09:27 devstack sudo[86029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:28 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150 1G" returned: 0 in 0.548s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1e8bd14-7305-4652-aac3-f32f555c33b5 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:28 devstack sudo[86037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1e8bd14-7305-4652-aac3-f32f555c33b5 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150 Apr 07 06:09:28 devstack sudo[86037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:28 devstack sudo[86029]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-29166f92-7b01-446c-9cc3-c611788fabaf" returned: 0 in 0.562s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-29166f92-7b01-446c-9cc3-c611788fabaf {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:28 devstack sudo[86039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-29166f92-7b01-446c-9cc3-c611788fabaf Apr 07 06:09:28 devstack sudo[86039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:28 devstack sudo[86037]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1e8bd14-7305-4652-aac3-f32f555c33b5 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150" returned: 0 in 0.559s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:28 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150 is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:09:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:28 devstack sudo[86070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150 Apr 07 06:09:28 devstack sudo[86070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:29 devstack sudo[86039]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-29166f92-7b01-446c-9cc3-c611788fabaf" returned: 0 in 0.639s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:29 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-29166f92-7b01-446c-9cc3-c611788fabaf" released by "delete_volume" :: held 1.232s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:29 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] Created reservations ['361f5481-2443-4724-baec-ff0a669c714a'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:29 devstack cinder-volume[82475]: WARNING cinder.quota [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-718091908 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-718091908, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:09:29 devstack cinder-volume[82475]: WARNING cinder.quota [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-718091908 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-718091908, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:09:29 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] Created reservations ['ac392e15-38e7-441f-bc6e-cb6b7f70d4d0', '461fe62e-98f5-4d56-98c5-867ad8def75c', 'a9c9ed96-00a6-4cf1-8655-1a91262229be', '1aab9947-f0a2-48a9-8eb6-086ba3c2930f'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:29 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:29 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:29 devstack sudo[86073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:09:29 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:29 devstack sudo[86070]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150" returned: 0 in 0.719s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:29 devstack sudo[86079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.info Apr 07 06:09:29 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:29 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.559s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:29 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:09:29 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-2d5d7aa7-8db6-4d73-a812-b6cb021fb275 tempest-GroupSnapshotsTest-786210802 None] Delete group completed successfully. Apr 07 06:09:30 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] group_snapshot 4b2304d4-2a27-44bc-b32c-7e0456b2bce1: deleting Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] group_snapshot 4b2304d4-2a27-44bc-b32c-7e0456b2bce1: deleting {{(pid=82475) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 07 06:09:30 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.info" returned: 0 in 0.522s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:30 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.info is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "cinder-quobyte-4348c05a-0b53-4fbd-b687-b2fd212cac19" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-4348c05a-0b53-4fbd-b687-b2fd212cac19" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "cinder-quobyte-41450267-c2a3-4f56-8134-cb9e5060b2bd" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-41450267-c2a3-4f56-8134-cb9e5060b2bd" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:30 devstack sudo[86083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.info Apr 07 06:09:30 devstack sudo[86083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] Deleting offline snapshot 41450267-c2a3-4f56-8134-cb9e5060b2bd of volume 4348c05a-0b53-4fbd-b687-b2fd212cac19 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] snapshot_file for this snap is: volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[624c4945-6866-4abb-a45a-c81cb3d45f6c]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:30 devstack sudo[86085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd Apr 07 06:09:30 devstack sudo[86085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:30 devstack sudo[86083]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.info" returned: 0 in 0.604s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.671s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.519s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-524502686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12cea721-8156-42be-9de5-70a4134d2101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be74749488724dc9b02f5a944d48b1bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:25Z,use_quota=True,user_id='a3e3c65a82a942b8b941d7aae5e144d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Creating volume 12cea721-8156-42be-9de5-70a4134d2101 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:09:30 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:30 devstack sudo[86093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101 1073741824 Apr 07 06:09:30 devstack sudo[86093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:30 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-7d06a2f8-13e7-4812-b184-7b8552cb7696 tempest-GroupSnapshotsV319Test-294580359 None] group_snapshot 8b5851f3-0a31-4f34-9cd5-5af324bab192: created successfully Apr 07 06:09:30 devstack sudo[86085]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd" returned: 0 in 0.670s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4348c05a-0b53-4fbd-b687-b2fd212cac19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[9130a80e-c3c9-44e2-b715-dd4f71914538]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:30 devstack sudo[86095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 Apr 07 06:09:30 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:31 devstack sudo[86093]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101 1073741824" returned: 0 in 0.670s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:31 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] group_snapshot 8b5851f3-0a31-4f34-9cd5-5af324bab192: deleting Apr 07 06:09:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:31 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19" returned: 0 in 0.655s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:31 devstack sudo[86103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101 Apr 07 06:09:31 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:31 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] group_snapshot 8b5851f3-0a31-4f34-9cd5-5af324bab192: deleting {{(pid=82475) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 07 06:09:31 devstack sudo[86105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd Apr 07 06:09:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] Acquiring lock "cinder-quobyte-e1e8bd14-7305-4652-aac3-f32f555c33b5" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:31 devstack sudo[86105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] Lock "cinder-quobyte-e1e8bd14-7305-4652-aac3-f32f555c33b5" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] Acquiring lock "cinder-quobyte-db4fc5a6-10fc-46bd-81f6-feec92f7a150" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] Lock "cinder-quobyte-db4fc5a6-10fc-46bd-81f6-feec92f7a150" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] Deleting offline snapshot db4fc5a6-10fc-46bd-81f6-feec92f7a150 of volume e1e8bd14-7305-4652-aac3-f32f555c33b5 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:09:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] snapshot_file for this snap is: volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:09:31 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[2749640a-7aa7-4409-aa21-b424cce9dcff]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2d2e2ed6-c6bf-4c83-975c-f898eabdfa51 tempest-VolumesActionsTest-48704033 None] Acquiring lock "cinder-a27db357-b40d-4db2-bd33-fd4803e7f285" by "attach_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2d2e2ed6-c6bf-4c83-975c-f898eabdfa51 tempest-VolumesActionsTest-48704033 None] Lock "cinder-a27db357-b40d-4db2-bd33-fd4803e7f285" acquired by "attach_volume" :: waited 0.018s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:31 devstack sudo[86107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150 Apr 07 06:09:31 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:31 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-2d2e2ed6-c6bf-4c83-975c-f898eabdfa51 tempest-VolumesActionsTest-48704033 None] Attaching volume a27db357-b40d-4db2-bd33-fd4803e7f285 to instance c1affea0-9958-413b-a8d4-6004e5921afc at mountpoint /dev/vdb on host None. Apr 07 06:09:31 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-2d2e2ed6-c6bf-4c83-975c-f898eabdfa51 tempest-VolumesActionsTest-48704033 None] Attach volume completed successfully. Apr 07 06:09:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2d2e2ed6-c6bf-4c83-975c-f898eabdfa51 tempest-VolumesActionsTest-48704033 None] Lock "cinder-a27db357-b40d-4db2-bd33-fd4803e7f285" released by "attach_volume" :: held 0.132s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:32 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101" returned: 0 in 0.670s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599235da-49c9-43c4-b7f9-8b9004ba40af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12cea721-8156-42be-9de5-70a4134d2101', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2d3556-e18a-4bdf-9941-b0b99bdaadad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:32 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Volume volume-12cea721-8156-42be-9de5-70a4134d2101 (12cea721-8156-42be-9de5-70a4134d2101): created successfully Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2d3556-e18a-4bdf-9941-b0b99bdaadad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Flow 'volume_create_manager' (c215b13e-ca1b-4e6e-b843-36694bda155f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:32 devstack cinder-volume[82475]: INFO cinder.volume.manager [req-20ac1f1f-2db1-4677-a2d6-594e9d3309db req-cafb7609-a911-4191-9213-b0ba2a80a676 tempest-VolumesSnapshotsTestJSON-407600005 None] Created volume successfully. Apr 07 06:09:32 devstack sudo[86105]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd" returned: 0 in 0.713s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:32 devstack sudo[86116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd Apr 07 06:09:32 devstack sudo[86116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:32 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150" returned: 0 in 0.662s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1e8bd14-7305-4652-aac3-f32f555c33b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7f75af-df50-44ce-a1a5-54b363c448e3]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4e0a2263-faf4-4fa2-9b51-17a02bf81750 tempest-VolumesActionsTest-48704033 None] Acquiring lock "cinder-a27db357-b40d-4db2-bd33-fd4803e7f285-detach_volume" by "detach_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4e0a2263-faf4-4fa2-9b51-17a02bf81750 tempest-VolumesActionsTest-48704033 None] Lock "cinder-a27db357-b40d-4db2-bd33-fd4803e7f285-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:32 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-4e0a2263-faf4-4fa2-9b51-17a02bf81750 tempest-VolumesActionsTest-48704033 None] Detaching volume a27db357-b40d-4db2-bd33-fd4803e7f285 from instance c1affea0-9958-413b-a8d4-6004e5921afc. Apr 07 06:09:32 devstack sudo[86118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5 Apr 07 06:09:32 devstack sudo[86118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:32 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-4e0a2263-faf4-4fa2-9b51-17a02bf81750 tempest-VolumesActionsTest-48704033 None] Detach volume completed successfully. Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4e0a2263-faf4-4fa2-9b51-17a02bf81750 tempest-VolumesActionsTest-48704033 None] Lock "cinder-a27db357-b40d-4db2-bd33-fd4803e7f285-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:32 devstack sudo[86116]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19.41450267-c2a3-4f56-8134-cb9e5060b2bd" returned: 0 in 0.465s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-41450267-c2a3-4f56-8134-cb9e5060b2bd" released by "_delete_snapshot" :: held 2.567s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-4348c05a-0b53-4fbd-b687-b2fd212cac19" released by "delete_snapshot" :: held 2.582s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:32 devstack cinder-volume[82475]: WARNING cinder.quota [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-718091908 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-718091908, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] Created reservations ['e369ca1f-e387-4eb1-973d-1752b0791136', 'ff15461b-3b49-4418-b229-225d930b33a4', '379df8c2-271a-454d-badf-e8afa1eb1cb7', 'b3c3eb75-18bc-4fd0-baac-328f5b0f0501'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:32 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-88bd2fcb-fc76-4f08-8c01-7e9e9e43a3a2 tempest-GroupSnapshotsTest-786210802 None] group_snapshot 4b2304d4-2a27-44bc-b32c-7e0456b2bce1: deleted successfully Apr 07 06:09:32 devstack sudo[86118]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5" returned: 0 in 0.544s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:32 devstack sudo[86124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150 Apr 07 06:09:32 devstack sudo[86124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-53f55105-98ca-429d-9a75-a8614b7861d8 req-17441d49-39e9-4d44-b66b-b843c8e257ec tempest-VolumesSnapshotsTestJSON-407600005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-53f55105-98ca-429d-9a75-a8614b7861d8 req-17441d49-39e9-4d44-b66b-b843c8e257ec tempest-VolumesSnapshotsTestJSON-407600005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:33 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [req-53f55105-98ca-429d-9a75-a8614b7861d8 req-17441d49-39e9-4d44-b66b-b843c8e257ec tempest-VolumesSnapshotsTestJSON-407600005 None] Creating offline snapshot e36e501f-740d-4193-8e6b-0c17f695f5fe of volume 12cea721-8156-42be-9de5-70a4134d2101 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:09:33 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75cbd33-533b-428b-a74c-bf3ae2ca5a7d]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-53f55105-98ca-429d-9a75-a8614b7861d8 req-17441d49-39e9-4d44-b66b-b843c8e257ec tempest-VolumesSnapshotsTestJSON-407600005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:33 devstack sudo[86127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101 Apr 07 06:09:33 devstack sudo[86127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:33 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a5a75ee5-a5d4-4be9-8416-4b634950a5cb tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "cinder-quobyte-4348c05a-0b53-4fbd-b687-b2fd212cac19" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:33 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a5a75ee5-a5d4-4be9-8416-4b634950a5cb tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-4348c05a-0b53-4fbd-b687-b2fd212cac19" acquired by "delete_volume" :: waited 0.018s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:33 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[4250bd19-705d-4f2f-bf61-7a618dc7d0de]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a5a75ee5-a5d4-4be9-8416-4b634950a5cb tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:33 devstack sudo[86124]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150" returned: 0 in 0.830s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:33 devstack sudo[86133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150 Apr 07 06:09:33 devstack sudo[86133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:33 devstack sudo[86132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 Apr 07 06:09:33 devstack sudo[86132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:34 devstack sudo[86127]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-53f55105-98ca-429d-9a75-a8614b7861d8 req-17441d49-39e9-4d44-b66b-b843c8e257ec tempest-VolumesSnapshotsTestJSON-407600005 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101" returned: 0 in 0.803s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-53f55105-98ca-429d-9a75-a8614b7861d8 req-17441d49-39e9-4d44-b66b-b843c8e257ec tempest-VolumesSnapshotsTestJSON-407600005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:34 devstack sudo[86139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe 1G Apr 07 06:09:34 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:34 devstack sudo[86132]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a5a75ee5-a5d4-4be9-8416-4b634950a5cb tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19" returned: 0 in 0.577s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a5a75ee5-a5d4-4be9-8416-4b634950a5cb tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:34 devstack sudo[86133]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5.db4fc5a6-10fc-46bd-81f6-feec92f7a150" returned: 0 in 0.546s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] Lock "cinder-quobyte-db4fc5a6-10fc-46bd-81f6-feec92f7a150" released by "_delete_snapshot" :: held 2.648s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:34 devstack sudo[86153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19 Apr 07 06:09:34 devstack sudo[86153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] Lock "cinder-quobyte-e1e8bd14-7305-4652-aac3-f32f555c33b5" released by "delete_snapshot" :: held 2.661s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:34 devstack cinder-volume[82475]: WARNING cinder.quota [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-555480981 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-555480981, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:09:34 devstack cinder-volume[82475]: WARNING cinder.quota [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-555480981 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-555480981, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:09:34 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] Created reservations ['5b2e1e1b-dc73-40a1-ba3f-97ae9e85a5b5', 'dbeb9e56-20f6-4c15-a8d0-2dc0d7b0b412', '076ba5f2-fdd9-4234-bf52-58ead2499294', 'ab66edf8-94fc-467c-bc89-b07c72583241'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:34 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-2b58d64d-4686-4aa9-9974-779cea5f3163 tempest-GroupSnapshotsV319Test-294580359 None] group_snapshot 8b5851f3-0a31-4f34-9cd5-5af324bab192: deleted successfully Apr 07 06:09:34 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-53f55105-98ca-429d-9a75-a8614b7861d8 req-17441d49-39e9-4d44-b66b-b843c8e257ec tempest-VolumesSnapshotsTestJSON-407600005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe 1G" returned: 0 in 0.730s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-53f55105-98ca-429d-9a75-a8614b7861d8 req-17441d49-39e9-4d44-b66b-b843c8e257ec tempest-VolumesSnapshotsTestJSON-407600005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12cea721-8156-42be-9de5-70a4134d2101 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:34 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12cea721-8156-42be-9de5-70a4134d2101 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe Apr 07 06:09:34 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:34 devstack sudo[86153]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a5a75ee5-a5d4-4be9-8416-4b634950a5cb tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4348c05a-0b53-4fbd-b687-b2fd212cac19" returned: 0 in 0.581s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a5a75ee5-a5d4-4be9-8416-4b634950a5cb tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-4348c05a-0b53-4fbd-b687-b2fd212cac19" released by "delete_volume" :: held 1.203s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:34 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-a5a75ee5-a5d4-4be9-8416-4b634950a5cb tempest-GroupSnapshotsTest-786210802 None] Created reservations ['83b6066b-939a-4104-ac20-439ffc87887f'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:34 devstack cinder-volume[82475]: WARNING cinder.db.sqlalchemy.api [None req-a5a75ee5-a5d4-4be9-8416-4b634950a5cb tempest-GroupSnapshotsTest-786210802 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-718091908'] Apr 07 06:09:34 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-a5a75ee5-a5d4-4be9-8416-4b634950a5cb tempest-GroupSnapshotsTest-786210802 None] Created reservations ['3c236714-2b78-46b7-9194-a1ec27f1540a', 'a4261131-09e2-4f14-8e5b-8d8bcf4bb83f', '33395a98-d909-459f-9e6b-d6cfde643577', '671f0391-31b6-487a-8526-be3647e04884'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a5a75ee5-a5d4-4be9-8416-4b634950a5cb tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a5a75ee5-a5d4-4be9-8416-4b634950a5cb tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a5a75ee5-a5d4-4be9-8416-4b634950a5cb tempest-GroupSnapshotsTest-786210802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a5a75ee5-a5d4-4be9-8416-4b634950a5cb tempest-GroupSnapshotsTest-786210802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a5a75ee5-a5d4-4be9-8416-4b634950a5cb tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a5a75ee5-a5d4-4be9-8416-4b634950a5cb tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:35 devstack sudo[86181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:09:35 devstack sudo[86181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:35 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e9be6655-fa0e-4fe7-9ec7-3606f142ff20 tempest-GroupSnapshotsV319Test-294580359 None] Acquiring lock "cinder-quobyte-e1e8bd14-7305-4652-aac3-f32f555c33b5" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:35 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e9be6655-fa0e-4fe7-9ec7-3606f142ff20 tempest-GroupSnapshotsV319Test-294580359 None] Lock "cinder-quobyte-e1e8bd14-7305-4652-aac3-f32f555c33b5" acquired by "delete_volume" :: waited 0.020s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:35 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[337295db-8b3d-4a15-b359-a4a3886c0566]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e9be6655-fa0e-4fe7-9ec7-3606f142ff20 tempest-GroupSnapshotsV319Test-294580359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:35 devstack sudo[86186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5 Apr 07 06:09:35 devstack sudo[86186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:35 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-53f55105-98ca-429d-9a75-a8614b7861d8 req-17441d49-39e9-4d44-b66b-b843c8e257ec tempest-VolumesSnapshotsTestJSON-407600005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12cea721-8156-42be-9de5-70a4134d2101 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe" returned: 0 in 0.511s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:35 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [req-53f55105-98ca-429d-9a75-a8614b7861d8 req-17441d49-39e9-4d44-b66b-b843c8e257ec tempest-VolumesSnapshotsTestJSON-407600005 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe is being set with open permissions: ugo+rw Apr 07 06:09:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-53f55105-98ca-429d-9a75-a8614b7861d8 req-17441d49-39e9-4d44-b66b-b843c8e257ec tempest-VolumesSnapshotsTestJSON-407600005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:35 devstack sudo[86188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe Apr 07 06:09:35 devstack sudo[86188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:35 devstack sudo[86181]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a5a75ee5-a5d4-4be9-8416-4b634950a5cb tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.536s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:35 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-a5a75ee5-a5d4-4be9-8416-4b634950a5cb tempest-GroupSnapshotsTest-786210802 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:09:35 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-a5a75ee5-a5d4-4be9-8416-4b634950a5cb tempest-GroupSnapshotsTest-786210802 None] Delete group completed successfully. Apr 07 06:09:35 devstack sudo[86186]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e9be6655-fa0e-4fe7-9ec7-3606f142ff20 tempest-GroupSnapshotsV319Test-294580359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5" returned: 0 in 0.642s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e9be6655-fa0e-4fe7-9ec7-3606f142ff20 tempest-GroupSnapshotsV319Test-294580359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:35 devstack sudo[86196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5 Apr 07 06:09:35 devstack sudo[86196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:35 devstack sudo[86188]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-53f55105-98ca-429d-9a75-a8614b7861d8 req-17441d49-39e9-4d44-b66b-b843c8e257ec tempest-VolumesSnapshotsTestJSON-407600005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe" returned: 0 in 0.627s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-53f55105-98ca-429d-9a75-a8614b7861d8 req-17441d49-39e9-4d44-b66b-b843c8e257ec tempest-VolumesSnapshotsTestJSON-407600005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:35 devstack sudo[86198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.info Apr 07 06:09:35 devstack sudo[86198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:36 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-419b3728-f285-4c6f-a47e-f5e3adadb9ec tempest-GroupSnapshotsTest-786210802 None] Group tempest-GroupSnapshotsTest-Group-1120056228: creating Apr 07 06:09:36 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-419b3728-f285-4c6f-a47e-f5e3adadb9ec tempest-GroupSnapshotsTest-786210802 None] Group tempest-GroupSnapshotsTest-Group-1120056228: created successfully Apr 07 06:09:36 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-419b3728-f285-4c6f-a47e-f5e3adadb9ec tempest-GroupSnapshotsTest-786210802 None] Create group completed successfully. Apr 07 06:09:36 devstack sudo[86196]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e9be6655-fa0e-4fe7-9ec7-3606f142ff20 tempest-GroupSnapshotsV319Test-294580359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1e8bd14-7305-4652-aac3-f32f555c33b5" returned: 0 in 0.759s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:36 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e9be6655-fa0e-4fe7-9ec7-3606f142ff20 tempest-GroupSnapshotsV319Test-294580359 None] Lock "cinder-quobyte-e1e8bd14-7305-4652-aac3-f32f555c33b5" released by "delete_volume" :: held 1.436s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:36 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-e9be6655-fa0e-4fe7-9ec7-3606f142ff20 tempest-GroupSnapshotsV319Test-294580359 None] Created reservations ['541e0658-127f-4d72-942d-be3be3cc6fcc'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:36 devstack sudo[86198]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-53f55105-98ca-429d-9a75-a8614b7861d8 req-17441d49-39e9-4d44-b66b-b843c8e257ec tempest-VolumesSnapshotsTestJSON-407600005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.info" returned: 0 in 0.707s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:36 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [req-53f55105-98ca-429d-9a75-a8614b7861d8 req-17441d49-39e9-4d44-b66b-b843c8e257ec tempest-VolumesSnapshotsTestJSON-407600005 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.info is being set with open permissions: ugo+rw Apr 07 06:09:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-53f55105-98ca-429d-9a75-a8614b7861d8 req-17441d49-39e9-4d44-b66b-b843c8e257ec tempest-VolumesSnapshotsTestJSON-407600005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:36 devstack sudo[86203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.info Apr 07 06:09:36 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:36 devstack cinder-volume[82475]: WARNING cinder.quota [None req-e9be6655-fa0e-4fe7-9ec7-3606f142ff20 tempest-GroupSnapshotsV319Test-294580359 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-555480981 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-555480981, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:09:36 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-e9be6655-fa0e-4fe7-9ec7-3606f142ff20 tempest-GroupSnapshotsV319Test-294580359 None] Created reservations ['bb35ff68-639f-4fe8-a4b0-703fbeadcd16', '762214e0-bd21-4192-a620-87d5c764c7c1', '0212492f-bea5-43f8-a34e-bf61aa60c498', '65a2d7b0-02c2-484f-a4da-ceeb7410afff'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e9be6655-fa0e-4fe7-9ec7-3606f142ff20 tempest-GroupSnapshotsV319Test-294580359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e9be6655-fa0e-4fe7-9ec7-3606f142ff20 tempest-GroupSnapshotsV319Test-294580359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e9be6655-fa0e-4fe7-9ec7-3606f142ff20 tempest-GroupSnapshotsV319Test-294580359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e9be6655-fa0e-4fe7-9ec7-3606f142ff20 tempest-GroupSnapshotsV319Test-294580359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e9be6655-fa0e-4fe7-9ec7-3606f142ff20 tempest-GroupSnapshotsV319Test-294580359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e9be6655-fa0e-4fe7-9ec7-3606f142ff20 tempest-GroupSnapshotsV319Test-294580359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:36 devstack sudo[86205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:09:36 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:37 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-53f55105-98ca-429d-9a75-a8614b7861d8 req-17441d49-39e9-4d44-b66b-b843c8e257ec tempest-VolumesSnapshotsTestJSON-407600005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.info" returned: 0 in 0.455s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-53f55105-98ca-429d-9a75-a8614b7861d8 req-17441d49-39e9-4d44-b66b-b843c8e257ec tempest-VolumesSnapshotsTestJSON-407600005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.919s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:37 devstack cinder-volume[82475]: INFO cinder.volume.manager [req-53f55105-98ca-429d-9a75-a8614b7861d8 req-17441d49-39e9-4d44-b66b-b843c8e257ec tempest-VolumesSnapshotsTestJSON-407600005 None] Create snapshot completed successfully Apr 07 06:09:37 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e9be6655-fa0e-4fe7-9ec7-3606f142ff20 tempest-GroupSnapshotsV319Test-294580359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.520s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-e9be6655-fa0e-4fe7-9ec7-3606f142ff20 tempest-GroupSnapshotsV319Test-294580359 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:09:37 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-e9be6655-fa0e-4fe7-9ec7-3606f142ff20 tempest-GroupSnapshotsV319Test-294580359 None] Delete group completed successfully. Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] Acquiring lock "cinder-e36e501f-740d-4193-8e6b-0c17f695f5fe-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] Lock "cinder-e36e501f-740d-4193-8e6b-0c17f695f5fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] Acquiring lock "cinder-quobyte-12cea721-8156-42be-9de5-70a4134d2101" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] Lock "cinder-quobyte-12cea721-8156-42be-9de5-70a4134d2101" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] Acquiring lock "cinder-quobyte-e36e501f-740d-4193-8e6b-0c17f695f5fe" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] Lock "cinder-quobyte-e36e501f-740d-4193-8e6b-0c17f695f5fe" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] Deleting offline snapshot e36e501f-740d-4193-8e6b-0c17f695f5fe of volume 12cea721-8156-42be-9de5-70a4134d2101 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] snapshot_file for this snap is: volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6214507-6460-4b1a-b2c7-20073a42550c]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Flow 'volume_create_manager' (d844bb2f-bdde-477d-8998-0b49bb6ba2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1db1c7-7c02-4d88-8bd4-0b2c3b042af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1db1c7-7c02-4d88-8bd4-0b2c3b042af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-480825773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=436439e3-7583-4e3a-a1b6-934be30da055,host='devstack@QuobyteHD#QuobyteHD',id=78158f7e-11f1-4a73-b834-8ac4b2586d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d096b43038f44349eadd58a7d92c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:38Z,use_quota=True,user_id='a08c2d4f6eaf47adad5dac1cc3efdf1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4510cf1-76a8-44f6-ba75-d43a5b964e5e),volume_type_id=f4510cf1-76a8-44f6-ba75-d43a5b964e5e)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6337fe75-57a1-4202-981d-528f569d5849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6337fe75-57a1-4202-981d-528f569d5849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7407d76-b87c-4fc2-b6c3-17d963ac947d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7407d76-b87c-4fc2-b6c3-17d963ac947d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78158f7e-11f1-4a73-b834-8ac4b2586d9b', 'volume_name': 'volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279f9093-a562-4e08-9b3a-c0be47a9fe53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:37 devstack sudo[86209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279f9093-a562-4e08-9b3a-c0be47a9fe53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:37 devstack sudo[86209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d145a13f-cae7-4a30-a8d4-bb687bae97b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:37 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Volume 78158f7e-11f1-4a73-b834-8ac4b2586d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b', 'volume_size': 1} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=436439e3-7583-4e3a-a1b6-934be30da055,created_at=2026-04-07T04:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-480825773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=436439e3-7583-4e3a-a1b6-934be30da055,host='devstack@QuobyteHD#QuobyteHD',id=78158f7e-11f1-4a73-b834-8ac4b2586d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d096b43038f44349eadd58a7d92c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:38Z,use_quota=True,user_id='a08c2d4f6eaf47adad5dac1cc3efdf1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4510cf1-76a8-44f6-ba75-d43a5b964e5e),volume_type_id=f4510cf1-76a8-44f6-ba75-d43a5b964e5e)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Creating volume 78158f7e-11f1-4a73-b834-8ac4b2586d9b {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:09:37 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:09:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:37 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b 1073741824 Apr 07 06:09:37 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:38 devstack sudo[86209]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe" returned: 0 in 0.695s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12cea721-8156-42be-9de5-70a4134d2101(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:09:38 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[626c07bd-818f-4593-ae95-a0dc9cf7d4a3]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:38 devstack sudo[86219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101 Apr 07 06:09:38 devstack sudo[86219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:38 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b 1073741824" returned: 0 in 0.736s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:38 devstack sudo[86221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b Apr 07 06:09:38 devstack sudo[86221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:39 devstack sudo[86219]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101" returned: 0 in 0.609s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:39 devstack sudo[86227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe Apr 07 06:09:39 devstack sudo[86227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:39 devstack sudo[86221]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b" returned: 0 in 0.528s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:09:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d145a13f-cae7-4a30-a8d4-bb687bae97b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5349dbe9-edf6-444e-ba1d-a765ffe9ab98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:39 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Volume volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b (78158f7e-11f1-4a73-b834-8ac4b2586d9b): created successfully Apr 07 06:09:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5349dbe9-edf6-444e-ba1d-a765ffe9ab98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Flow 'volume_create_manager' (d844bb2f-bdde-477d-8998-0b49bb6ba2cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:39 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-010ac13c-e7d2-4060-aa9b-a30788a6559d tempest-GroupSnapshotsTest-786210802 None] Created volume successfully. Apr 07 06:09:39 devstack sudo[86227]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe" returned: 0 in 0.643s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:39 devstack sudo[86233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe Apr 07 06:09:39 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:40 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101.e36e501f-740d-4193-8e6b-0c17f695f5fe" returned: 0 in 0.529s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] Lock "cinder-quobyte-e36e501f-740d-4193-8e6b-0c17f695f5fe" released by "_delete_snapshot" :: held 2.603s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] Lock "cinder-quobyte-12cea721-8156-42be-9de5-70a4134d2101" released by "delete_snapshot" :: held 2.619s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:40 devstack cinder-volume[82475]: WARNING cinder.quota [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.quota [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] Created reservations ['08a13bb5-f49a-479d-ae05-0aa3d7d48778', '45af515e-eb8b-4800-b250-d27d4312e24d', '2726b1d9-6d49-4c18-a87d-0be936537ba8', '67331187-0a0d-4204-8756-1720752d2c64'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Flow 'volume_create_manager' (07af35e5-0320-4a17-a19d-d3c70315e039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60d5244-a128-4b41-92d3-903488f24b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60d5244-a128-4b41-92d3-903488f24b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-622681720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=436439e3-7583-4e3a-a1b6-934be30da055,host='devstack@QuobyteHD#QuobyteHD',id=658ba698-f7bf-4184-ba40-7c5eccf8ce24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d096b43038f44349eadd58a7d92c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:40Z,use_quota=True,user_id='a08c2d4f6eaf47adad5dac1cc3efdf1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4510cf1-76a8-44f6-ba75-d43a5b964e5e),volume_type_id=f4510cf1-76a8-44f6-ba75-d43a5b964e5e)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a448f27-f7d3-4472-9713-a5af21706483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a448f27-f7d3-4472-9713-a5af21706483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a94cb4-8955-487b-913a-4c26d55ebd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a94cb4-8955-487b-913a-4c26d55ebd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '658ba698-f7bf-4184-ba40-7c5eccf8ce24', 'volume_name': 'volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdba4ad5-1683-46b5-8905-8a8c47dca214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdba4ad5-1683-46b5-8905-8a8c47dca214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960fd6f9-9a7b-4127-bf3a-e0ed3bc92b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:40 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Volume 658ba698-f7bf-4184-ba40-7c5eccf8ce24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24', 'volume_size': 1} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=436439e3-7583-4e3a-a1b6-934be30da055,created_at=2026-04-07T04:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-622681720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=436439e3-7583-4e3a-a1b6-934be30da055,host='devstack@QuobyteHD#QuobyteHD',id=658ba698-f7bf-4184-ba40-7c5eccf8ce24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d096b43038f44349eadd58a7d92c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:40Z,use_quota=True,user_id='a08c2d4f6eaf47adad5dac1cc3efdf1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4510cf1-76a8-44f6-ba75-d43a5b964e5e),volume_type_id=f4510cf1-76a8-44f6-ba75-d43a5b964e5e)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Creating volume 658ba698-f7bf-4184-ba40-7c5eccf8ce24 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:09:40 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:40 devstack sudo[86236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24 1073741824 Apr 07 06:09:40 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:40 devstack cinder-volume[82475]: INFO cinder.volume.manager [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] Delete snapshot completed successfully. Apr 07 06:09:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-589deecb-0342-4f85-a9f2-1425bfc2653c req-4e53e5af-1965-4d51-9dab-d2df9b68b151 tempest-VolumesSnapshotsTestJSON-407600005 None] Lock "cinder-e36e501f-740d-4193-8e6b-0c17f695f5fe-delete_snapshot" released by "delete_snapshot" :: held 2.942s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-46a5d1e6-e5a3-4125-8a0f-9f5307b88767 tempest-VolumesActionsTest-48704033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] Acquiring lock "cinder-12cea721-8156-42be-9de5-70a4134d2101-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] Lock "cinder-12cea721-8156-42be-9de5-70a4134d2101-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] Acquiring lock "cinder-quobyte-12cea721-8156-42be-9de5-70a4134d2101" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] Lock "cinder-quobyte-12cea721-8156-42be-9de5-70a4134d2101" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bd9ad5-5533-41e9-9adc-37282a4ad1de]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:41 devstack sudo[86241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101 Apr 07 06:09:41 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:41 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24 1073741824" returned: 0 in 0.677s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:41 devstack sudo[86243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24 Apr 07 06:09:41 devstack sudo[86243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:41 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101" returned: 0 in 0.628s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:41 devstack sudo[86249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101 Apr 07 06:09:41 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:41 devstack sudo[86243]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24" returned: 0 in 0.548s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-46a5d1e6-e5a3-4125-8a0f-9f5307b88767 tempest-VolumesActionsTest-48704033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.885s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dfb483-fdde-4f44-9f8c-70a3980af863]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-46a5d1e6-e5a3-4125-8a0f-9f5307b88767 tempest-VolumesActionsTest-48704033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960fd6f9-9a7b-4127-bf3a-e0ed3bc92b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb7fdc0-33e2-409f-98b3-4001935db857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:41 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-0384e955-7cc3-4c1f-bf5d-c3486a5076c3 tempest-GroupsTest-573961480 None] Group tempest-Group1-836473296: creating Apr 07 06:09:41 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Volume volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24 (658ba698-f7bf-4184-ba40-7c5eccf8ce24): created successfully Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb7fdc0-33e2-409f-98b3-4001935db857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Flow 'volume_create_manager' (07af35e5-0320-4a17-a19d-d3c70315e039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:41 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-24a7b1fb-2fd6-4270-95ee-cbd76a53c0c2 tempest-GroupSnapshotsTest-786210802 None] Created volume successfully. Apr 07 06:09:41 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-0384e955-7cc3-4c1f-bf5d-c3486a5076c3 tempest-GroupsTest-573961480 None] Group tempest-Group1-836473296: created successfully Apr 07 06:09:41 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-0384e955-7cc3-4c1f-bf5d-c3486a5076c3 tempest-GroupsTest-573961480 None] Create group completed successfully. Apr 07 06:09:41 devstack sudo[86251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 Apr 07 06:09:41 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:42 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12cea721-8156-42be-9de5-70a4134d2101" returned: 0 in 0.470s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:42 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] Lock "cinder-quobyte-12cea721-8156-42be-9de5-70a4134d2101" released by "delete_volume" :: held 1.132s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:42 devstack cinder-volume[82475]: DEBUG cinder.quota [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] Created reservations ['8e05a0fc-eefc-42ff-80cf-0b7820564bc1', '3cf84fb4-fcaa-413d-b6e2-a3e84a7ec581', '169d8d0e-77ec-4e96-871b-3a0b3a147c83', '00d22919-2e5d-49b9-affa-ec381e48bf86'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:09:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:42 devstack sudo[86256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:09:42 devstack sudo[86256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:42 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-46a5d1e6-e5a3-4125-8a0f-9f5307b88767 tempest-VolumesActionsTest-48704033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285" returned: 0 in 0.545s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:42 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[95484f64-84ec-42e1-b1a6-38c03117bc49]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-46a5d1e6-e5a3-4125-8a0f-9f5307b88767 tempest-VolumesActionsTest-48704033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:42 devstack sudo[86259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 Apr 07 06:09:42 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:42 devstack sudo[86256]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:42 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-4f9c3598-8076-4a0f-9526-7a803e08152e tempest-GroupSnapshotsTest-786210802 None] Update group completed successfully. Apr 07 06:09:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.466s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:42 devstack cinder-volume[82475]: DEBUG cinder.manager [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:09:42 devstack cinder-volume[82475]: INFO cinder.volume.manager [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] Deleted volume successfully. Apr 07 06:09:42 devstack cinder-volume[82475]: DEBUG cinder.coordination [req-2662cbfd-4c8f-4189-9143-e09982c5e027 req-dfdffdba-a81c-4f88-b081-7e5dfb044f54 tempest-VolumesSnapshotsTestJSON-407600005 None] Lock "cinder-12cea721-8156-42be-9de5-70a4134d2101-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:09:43 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-46a5d1e6-e5a3-4125-8a0f-9f5307b88767 tempest-VolumesActionsTest-48704033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285" returned: 0 in 0.559s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-46a5d1e6-e5a3-4125-8a0f-9f5307b88767 tempest-VolumesActionsTest-48704033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 /opt/stack/data/cinder/conversion/a27db357-b40d-4db2-bd33-fd4803e7f285.temp_image.2e720dad-5479-4b82-bd61-a95f6b295f37g1lqdlrd.img {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:43 devstack sudo[86265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 /opt/stack/data/cinder/conversion/a27db357-b40d-4db2-bd33-fd4803e7f285.temp_image.2e720dad-5479-4b82-bd61-a95f6b295f37g1lqdlrd.img Apr 07 06:09:43 devstack sudo[86265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:43 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-c6004bb4-ffd9-4ac4-9d80-5f8618d698d1 tempest-GroupsTest-573961480 None] Group tempest-Group2-310201035: creating Apr 07 06:09:43 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-c6004bb4-ffd9-4ac4-9d80-5f8618d698d1 tempest-GroupsTest-573961480 None] Group tempest-Group2-310201035: created successfully Apr 07 06:09:43 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-c6004bb4-ffd9-4ac4-9d80-5f8618d698d1 tempest-GroupsTest-573961480 None] Create group completed successfully. Apr 07 06:09:44 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-335e25a0-77c6-4092-aa07-67685f04fb57 tempest-GroupSnapshotsTest-786210802 None] Update group completed successfully. Apr 07 06:09:45 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:09:45 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Flow 'volume_create_manager' (557c051c-79d1-4726-aa9b-9d535706c523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:45 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffaff5a9-3b72-42bf-86a5-aaae132ef738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:45 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffaff5a9-3b72-42bf-86a5-aaae132ef738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1192341380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=495f3ecf-9a01-445c-9d57-a7043b1bd7b7,host='devstack@QuobyteHD#QuobyteHD',id=752617b3-b707-4950-b2b3-5211a16e6e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0c5a3984f64cf59772df115af427bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:45Z,use_quota=True,user_id='2b7f4309b7544fd4a724664092100afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf236ddc-5c58-46fc-83cf-c5a2e4603c40),volume_type_id=bf236ddc-5c58-46fc-83cf-c5a2e4603c40)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:45 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ec78a0-4a20-468e-af04-cfb8e2d9219d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:45 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ec78a0-4a20-468e-af04-cfb8e2d9219d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:45 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a25ee4-e552-4a0d-8446-d5f49e4be66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:45 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a25ee4-e552-4a0d-8446-d5f49e4be66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '752617b3-b707-4950-b2b3-5211a16e6e07', 'volume_name': 'volume-752617b3-b707-4950-b2b3-5211a16e6e07', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:45 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a3c37e-e597-4a28-89f1-6c463cd457ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:45 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a3c37e-e597-4a28-89f1-6c463cd457ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:45 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf9688bc-744f-41f8-a4ce-0709d9b37955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:45 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Volume 752617b3-b707-4950-b2b3-5211a16e6e07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-752617b3-b707-4950-b2b3-5211a16e6e07', 'volume_size': 1} Apr 07 06:09:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:45 devstack sudo[86265]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:45 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-fbf5b507-edd8-42d6-9af9-10862bca36ce tempest-GroupSnapshotsTest-786210802 None] Update group completed successfully. Apr 07 06:09:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-46a5d1e6-e5a3-4125-8a0f-9f5307b88767 tempest-VolumesActionsTest-48704033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 /opt/stack/data/cinder/conversion/a27db357-b40d-4db2-bd33-fd4803e7f285.temp_image.2e720dad-5479-4b82-bd61-a95f6b295f37g1lqdlrd.img" returned: 0 in 2.526s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:45 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39a328c-19c7-4a12-99aa-84f3339746b1]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-46a5d1e6-e5a3-4125-8a0f-9f5307b88767 tempest-VolumesActionsTest-48704033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:45 devstack sudo[86277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 Apr 07 06:09:45 devstack sudo[86277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:46 devstack sudo[86277]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-46a5d1e6-e5a3-4125-8a0f-9f5307b88767 tempest-VolumesActionsTest-48704033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285" returned: 0 in 0.682s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:46 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-46a5d1e6-e5a3-4125-8a0f-9f5307b88767 tempest-VolumesActionsTest-48704033 None] Image conversion details: src /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285, size 1024.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/conversion/a27db357-b40d-4db2-bd33-fd4803e7f285.temp_image.2e720dad-5479-4b82-bd61-a95f6b295f37g1lqdlrd.img {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:09:46 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-46a5d1e6-e5a3-4125-8a0f-9f5307b88767 tempest-VolumesActionsTest-48704033 None] Converted 1024.00 MB image at 405.29 MB/s Apr 07 06:09:46 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-46a5d1e6-e5a3-4125-8a0f-9f5307b88767 tempest-VolumesActionsTest-48704033 None] 2e720dad-5479-4b82-bd61-a95f6b295f37 was raw, no need to convert to raw {{(pid=82475) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 07 06:09:46 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-854b5774-cec0-4981-b35b-e0c502e69487 tempest-GroupSnapshotsTest-786210802 None] Update group completed successfully. Apr 07 06:09:48 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] GroupSnapshot 5951dbb5-e91c-4016-bdd4-98c69fc57b00: creating. Apr 07 06:09:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Group snapshot 5951dbb5-e91c-4016-bdd4-98c69fc57b00: creating. {{(pid=82475) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 07 06:09:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:51 devstack cinder-volume[82475]: DEBUG oslo_service.periodic_task [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82475) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:09:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:51 devstack sudo[86283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:09:51 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:52 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.573s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:52 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:09:55 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:09:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Flow 'volume_create_manager' (5697d8a5-0342-44a9-b147-cae1637a1c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:09:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54deb14-bfee-4a75-b285-2fb8c997aab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54deb14-bfee-4a75-b285-2fb8c997aab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1781624493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4224369e16f149ea94ed5612d36070a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:56Z,use_quota=True,user_id='a8e466c4fc1d425a93b6072f499ac093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e398bf-5f8f-42e4-935d-c7125afdafce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e398bf-5f8f-42e4-935d-c7125afdafce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05780b7f-8299-4a18-8e76-73971726f5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05780b7f-8299-4a18-8e76-73971726f5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67', 'volume_name': 'volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6791fe-b334-4480-9f23-038809e81d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6791fe-b334-4480-9f23-038809e81d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1294d482-d017-48be-ad2e-d5c0f270edb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:56 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Volume 4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67', 'volume_size': 1} Apr 07 06:09:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-46a5d1e6-e5a3-4125-8a0f-9f5307b88767 tempest-VolumesActionsTest-48704033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.922s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-46a5d1e6-e5a3-4125-8a0f-9f5307b88767 tempest-VolumesActionsTest-48704033 None] Uploaded volume to glance image-id: 2e720dad-5479-4b82-bd61-a95f6b295f37. {{(pid=82475) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 07 06:09:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.358s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:58 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=495f3ecf-9a01-445c-9d57-a7043b1bd7b7,created_at=2026-04-07T04:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1192341380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=495f3ecf-9a01-445c-9d57-a7043b1bd7b7,host='devstack@QuobyteHD#QuobyteHD',id=752617b3-b707-4950-b2b3-5211a16e6e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0c5a3984f64cf59772df115af427bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:45Z,use_quota=True,user_id='2b7f4309b7544fd4a724664092100afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf236ddc-5c58-46fc-83cf-c5a2e4603c40),volume_type_id=bf236ddc-5c58-46fc-83cf-c5a2e4603c40)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:09:58 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Creating volume 752617b3-b707-4950-b2b3-5211a16e6e07 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:09:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:09:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:58 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:09:58 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:09:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:58 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:09:58 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:09:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-752617b3-b707-4950-b2b3-5211a16e6e07 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:58 devstack sudo[86286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-752617b3-b707-4950-b2b3-5211a16e6e07 1073741824 Apr 07 06:09:58 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:58 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-46a5d1e6-e5a3-4125-8a0f-9f5307b88767 tempest-VolumesActionsTest-48704033 None] Copy volume to image completed successfully. Apr 07 06:09:59 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-752617b3-b707-4950-b2b3-5211a16e6e07 1073741824" returned: 0 in 0.625s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-752617b3-b707-4950-b2b3-5211a16e6e07 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:09:59 devstack sudo[86292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-752617b3-b707-4950-b2b3-5211a16e6e07 Apr 07 06:09:59 devstack sudo[86292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:09:59 devstack sudo[86292]: pam_unix(sudo:session): session closed for user root Apr 07 06:09:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-752617b3-b707-4950-b2b3-5211a16e6e07" returned: 0 in 0.466s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:09:59 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:09:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:09:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.791s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:09:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf9688bc-744f-41f8-a4ce-0709d9b37955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-752617b3-b707-4950-b2b3-5211a16e6e07', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:09:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9633904-632a-45e0-bd07-cb61a0af497c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:09:59 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Creating offline snapshot 33deed49-16c5-4476-a02e-6029a0f598fd of volume 78158f7e-11f1-4a73-b834-8ac4b2586d9b {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:09:59 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0402c2d-f374-49de-a953-70fbc6cfa906]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:09:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:00 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Volume volume-752617b3-b707-4950-b2b3-5211a16e6e07 (752617b3-b707-4950-b2b3-5211a16e6e07): created successfully Apr 07 06:10:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9633904-632a-45e0-bd07-cb61a0af497c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Flow 'volume_create_manager' (557c051c-79d1-4726-aa9b-9d535706c523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:00 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-c9d992d8-1945-4016-8be7-f73dfdd4e5f3 tempest-GroupsTest-573961480 None] Created volume successfully. Apr 07 06:10:00 devstack sudo[86296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b Apr 07 06:10:00 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:00 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b" returned: 0 in 0.722s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:00 devstack sudo[86301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd 1G Apr 07 06:10:00 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] Acquiring lock "cinder-quobyte-752617b3-b707-4950-b2b3-5211a16e6e07" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] Lock "cinder-quobyte-752617b3-b707-4950-b2b3-5211a16e6e07" acquired by "delete_volume" :: waited 0.015s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:01 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88111ed-dd25-4717-b2a7-5c665af8a500]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-752617b3-b707-4950-b2b3-5211a16e6e07 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:01 devstack sudo[86305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-752617b3-b707-4950-b2b3-5211a16e6e07 Apr 07 06:10:01 devstack sudo[86305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:01 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd 1G" returned: 0 in 0.631s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:01 devstack sudo[86308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd Apr 07 06:10:01 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:01 devstack sudo[86305]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-752617b3-b707-4950-b2b3-5211a16e6e07" returned: 0 in 0.618s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-752617b3-b707-4950-b2b3-5211a16e6e07 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:01 devstack sudo[86313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-752617b3-b707-4950-b2b3-5211a16e6e07 Apr 07 06:10:01 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:01 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd" returned: 0 in 0.601s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:01 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:10:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:01 devstack sudo[86318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd Apr 07 06:10:01 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:02 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-752617b3-b707-4950-b2b3-5211a16e6e07" returned: 0 in 0.545s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:02 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] Lock "cinder-quobyte-752617b3-b707-4950-b2b3-5211a16e6e07" released by "delete_volume" :: held 1.193s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:02 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] Created reservations ['705a93bf-5c4f-4ecb-a88c-e9eaa11d1119'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:02 devstack cinder-volume[82475]: WARNING cinder.quota [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1404523599 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1404523599, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:10:02 devstack cinder-volume[82475]: WARNING cinder.quota [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1404523599 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1404523599, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:10:02 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] Created reservations ['95b4b08b-6d8f-40de-8f67-a161b9804b8e', '0b882380-4718-413d-a34d-d16883476787', 'f10820ef-c379-4c6c-adf4-5f93fa9661ba', '65e80585-e8b2-4e44-91e8-38b36fb15326'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:02 devstack sudo[86322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:10:02 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:02 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd" returned: 0 in 0.608s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:02 devstack sudo[86324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.info Apr 07 06:10:02 devstack sudo[86324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:03 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.520s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:03 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:03 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-39902e60-4846-4510-8c29-2d99c2e70e26 tempest-GroupsTest-573961480 None] Delete group completed successfully. Apr 07 06:10:03 devstack sudo[86324]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.info" returned: 0 in 0.528s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:03 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.info is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:10:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:03 devstack sudo[86328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.info Apr 07 06:10:03 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:03 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-1ed25dff-2332-4e01-aa38-627078f82691 tempest-GroupsTest-573961480 None] Created reservations ['7ea7bdee-f23c-42a4-8b27-6436e3197d78'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1ed25dff-2332-4e01-aa38-627078f82691 tempest-GroupsTest-573961480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1ed25dff-2332-4e01-aa38-627078f82691 tempest-GroupsTest-573961480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1ed25dff-2332-4e01-aa38-627078f82691 tempest-GroupsTest-573961480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1ed25dff-2332-4e01-aa38-627078f82691 tempest-GroupsTest-573961480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1ed25dff-2332-4e01-aa38-627078f82691 tempest-GroupsTest-573961480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1ed25dff-2332-4e01-aa38-627078f82691 tempest-GroupsTest-573961480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:03 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:10:03 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:03 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.info" returned: 0 in 0.578s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.755s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Creating offline snapshot e2ca0a2d-32bb-439b-9083-610e2a82616d of volume 658ba698-f7bf-4184-ba40-7c5eccf8ce24 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:10:03 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[f956325f-d20b-4a5f-a55b-18e2625c891f]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:03 devstack sudo[86333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24 Apr 07 06:10:03 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:04 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1ed25dff-2332-4e01-aa38-627078f82691 tempest-GroupsTest-573961480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.604s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:04 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-1ed25dff-2332-4e01-aa38-627078f82691 tempest-GroupsTest-573961480 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:04 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-1ed25dff-2332-4e01-aa38-627078f82691 tempest-GroupsTest-573961480 None] Delete group completed successfully. Apr 07 06:10:04 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24" returned: 0 in 0.636s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:04 devstack sudo[86339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d 1G Apr 07 06:10:04 devstack sudo[86339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:05 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-a6939c8c-fdb0-4240-ba16-5b249ad2debc tempest-GroupsTest-573961480 None] Group tempest-GroupsTest-Group-722213015: creating Apr 07 06:10:05 devstack sudo[86339]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d 1G" returned: 0 in 0.759s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:05 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-a6939c8c-fdb0-4240-ba16-5b249ad2debc tempest-GroupsTest-573961480 None] Group tempest-GroupsTest-Group-722213015: created successfully Apr 07 06:10:05 devstack sudo[86350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d Apr 07 06:10:05 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:05 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-a6939c8c-fdb0-4240-ba16-5b249ad2debc tempest-GroupsTest-573961480 None] Create group completed successfully. Apr 07 06:10:05 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d" returned: 0 in 0.570s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:05 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:10:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:05 devstack sudo[86355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d Apr 07 06:10:05 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:06 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d" returned: 0 in 0.508s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:06 devstack sudo[86358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.info Apr 07 06:10:06 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:06 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:06 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Flow 'volume_create_manager' (6ab04b6c-c100-4b51-a3ce-46edd268b388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:06 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea2c96f-c10c-41f0-ba8e-c2ced08a7f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:06 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea2c96f-c10c-41f0-ba8e-c2ced08a7f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1867375529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=218aca3b-3446-429d-a958-a8851bf56393,host='devstack@QuobyteHD#QuobyteHD',id=c73c578a-02ea-44cc-abeb-e4212ee1b535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0c5a3984f64cf59772df115af427bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:07Z,use_quota=True,user_id='2b7f4309b7544fd4a724664092100afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2b460f1-9a98-4c9c-955d-3d756e69c7f3),volume_type_id=a2b460f1-9a98-4c9c-955d-3d756e69c7f3)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:06 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dba5e4d-9870-4ca2-9719-9d6407558e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:06 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dba5e4d-9870-4ca2-9719-9d6407558e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:06 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea5307a-512f-46b4-9eea-909ea5420755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:06 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea5307a-512f-46b4-9eea-909ea5420755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c73c578a-02ea-44cc-abeb-e4212ee1b535', 'volume_name': 'volume-c73c578a-02ea-44cc-abeb-e4212ee1b535', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:06 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a7d230-4e6e-4f8d-a0aa-108518c81058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:06 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a7d230-4e6e-4f8d-a0aa-108518c81058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:06 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7ecefd-dbe5-495b-9a5c-9c3afe12c19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:06 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Volume c73c578a-02ea-44cc-abeb-e4212ee1b535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c73c578a-02ea-44cc-abeb-e4212ee1b535', 'volume_size': 1} Apr 07 06:10:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:06 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.info" returned: 0 in 0.564s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:06 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.info is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:10:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:06 devstack sudo[86361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.info Apr 07 06:10:06 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:07 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.info" returned: 0 in 0.468s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.576s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 6.900s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:07 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[5112a13e-c8bc-4f51-aed2-8ddbec1ca13f]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:07 devstack sudo[86365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 Apr 07 06:10:07 devstack sudo[86365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:07 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-8bd3a723-b1c1-407e-823e-f2473f06fcab tempest-GroupSnapshotsTest-786210802 None] group_snapshot 5951dbb5-e91c-4016-bdd4-98c69fc57b00: created successfully Apr 07 06:10:07 devstack sudo[86365]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285" returned: 0 in 0.572s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:07 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[789fca43-7f6f-431b-a218-b0bf1dc3d3ef]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:07 devstack sudo[86371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 Apr 07 06:10:07 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:07 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] group_snapshot 5951dbb5-e91c-4016-bdd4-98c69fc57b00: deleting Apr 07 06:10:08 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] group_snapshot 5951dbb5-e91c-4016-bdd4-98c69fc57b00: deleting {{(pid=82475) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 07 06:10:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "cinder-quobyte-78158f7e-11f1-4a73-b834-8ac4b2586d9b" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-78158f7e-11f1-4a73-b834-8ac4b2586d9b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "cinder-quobyte-33deed49-16c5-4476-a02e-6029a0f598fd" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-33deed49-16c5-4476-a02e-6029a0f598fd" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Deleting offline snapshot 33deed49-16c5-4476-a02e-6029a0f598fd of volume 78158f7e-11f1-4a73-b834-8ac4b2586d9b {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:10:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] snapshot_file for this snap is: volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:10:08 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e256587-d627-46d4-8ec0-5d0bec7b4d6c]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:08 devstack sudo[86373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd Apr 07 06:10:08 devstack sudo[86373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:08 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285" returned: 0 in 0.569s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 /opt/stack/data/cinder/conversion/a27db357-b40d-4db2-bd33-fd4803e7f285.temp_image.9ba55e09-7823-4aae-8cb2-212c30e8b4111rs2n7dc.img {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:08 devstack sudo[86378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 /opt/stack/data/cinder/conversion/a27db357-b40d-4db2-bd33-fd4803e7f285.temp_image.9ba55e09-7823-4aae-8cb2-212c30e8b4111rs2n7dc.img Apr 07 06:10:08 devstack sudo[86378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:08 devstack sudo[86373]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd" returned: 0 in 0.599s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:10:08 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[725b6cee-b266-4cbf-89a3-9dc6b662bb7c]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:08 devstack sudo[86383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b Apr 07 06:10:08 devstack sudo[86383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:09 devstack sudo[86383]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b" returned: 0 in 1.041s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:09 devstack sudo[86399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd Apr 07 06:10:09 devstack sudo[86399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:10 devstack sudo[86399]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd" returned: 0 in 1.257s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:11 devstack sudo[86404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd Apr 07 06:10:11 devstack sudo[86404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:11 devstack sudo[86378]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 /opt/stack/data/cinder/conversion/a27db357-b40d-4db2-bd33-fd4803e7f285.temp_image.9ba55e09-7823-4aae-8cb2-212c30e8b4111rs2n7dc.img" returned: 0 in 2.646s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[993962b2-b41a-4df3-9efe-60db92f2c796]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:11 devstack sudo[86406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 Apr 07 06:10:11 devstack sudo[86406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:11 devstack sudo[86404]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b.33deed49-16c5-4476-a02e-6029a0f598fd" returned: 0 in 0.441s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-33deed49-16c5-4476-a02e-6029a0f598fd" released by "_delete_snapshot" :: held 3.415s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-78158f7e-11f1-4a73-b834-8ac4b2586d9b" released by "delete_snapshot" :: held 3.435s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:SELECT=147,cinder:UPDATE=114,cinder:INSERT=26,cinder:DELETE=4 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "cinder-quobyte-658ba698-f7bf-4184-ba40-7c5eccf8ce24" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-658ba698-f7bf-4184-ba40-7c5eccf8ce24" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "cinder-quobyte-e2ca0a2d-32bb-439b-9083-610e2a82616d" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-e2ca0a2d-32bb-439b-9083-610e2a82616d" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Deleting offline snapshot e2ca0a2d-32bb-439b-9083-610e2a82616d of volume 658ba698-f7bf-4184-ba40-7c5eccf8ce24 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] snapshot_file for this snap is: volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[f695a2c7-c3fe-4656-88b3-559e82d68c10]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:11 devstack sudo[86409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d Apr 07 06:10:11 devstack sudo[86409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:11 devstack sudo[86406]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285" returned: 0 in 0.660s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] Image conversion details: src /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285, size 1024.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/conversion/a27db357-b40d-4db2-bd33-fd4803e7f285.temp_image.9ba55e09-7823-4aae-8cb2-212c30e8b4111rs2n7dc.img {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:10:11 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] Converted 1024.00 MB image at 386.86 MB/s Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:INSERT=30,cinder:SELECT=148,cinder:UPDATE=134,cinder:DELETE=5 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] 9ba55e09-7823-4aae-8cb2-212c30e8b411 was raw, converting to qcow2 {{(pid=82475) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed513480-e500-490f-990a-ec54814ad652]: (4, 'raw') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a27db357-b40d-4db2-bd33-fd4803e7f285.temp_image.9ba55e09-7823-4aae-8cb2-212c30e8b4111rs2n7dc.img {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:11 devstack sudo[86414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a27db357-b40d-4db2-bd33-fd4803e7f285.temp_image.9ba55e09-7823-4aae-8cb2-212c30e8b4111rs2n7dc.img Apr 07 06:10:11 devstack sudo[86414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:12 devstack sudo[86409]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d" returned: 0 in 0.576s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:12 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:10:12 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45d6ade-4ae9-41ea-a317-bee7cf90a304]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:12 devstack sudo[86419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24 Apr 07 06:10:12 devstack sudo[86419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:12 devstack sudo[86414]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a27db357-b40d-4db2-bd33-fd4803e7f285.temp_image.9ba55e09-7823-4aae-8cb2-212c30e8b4111rs2n7dc.img" returned: 0 in 0.529s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a27db357-b40d-4db2-bd33-fd4803e7f285.temp_image.9ba55e09-7823-4aae-8cb2-212c30e8b4111rs2n7dc.img {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:12 devstack sudo[86423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a27db357-b40d-4db2-bd33-fd4803e7f285.temp_image.9ba55e09-7823-4aae-8cb2-212c30e8b4111rs2n7dc.img Apr 07 06:10:12 devstack sudo[86423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:12 devstack sudo[86419]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24" returned: 0 in 0.525s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:12 devstack sudo[86428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d Apr 07 06:10:12 devstack sudo[86428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:12 devstack sudo[86423]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a27db357-b40d-4db2-bd33-fd4803e7f285.temp_image.9ba55e09-7823-4aae-8cb2-212c30e8b4111rs2n7dc.img" returned: 1 in 0.509s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a27db357-b40d-4db2-bd33-fd4803e7f285.temp_image.9ba55e09-7823-4aae-8cb2-212c30e8b4111rs2n7dc.img' failed. Not Retrying. {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:10:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a27db357-b40d-4db2-bd33-fd4803e7f285.temp_image.9ba55e09-7823-4aae-8cb2-212c30e8b4111rs2n7dc.img /opt/stack/data/cinder/conversion/vol_upload_kp4g4z88 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:12 devstack sudo[86433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a27db357-b40d-4db2-bd33-fd4803e7f285.temp_image.9ba55e09-7823-4aae-8cb2-212c30e8b4111rs2n7dc.img /opt/stack/data/cinder/conversion/vol_upload_kp4g4z88 Apr 07 06:10:12 devstack sudo[86433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:13 devstack sudo[86428]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d" returned: 0 in 0.536s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:13 devstack sudo[86438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d Apr 07 06:10:13 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:13 devstack sudo[86433]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a27db357-b40d-4db2-bd33-fd4803e7f285.temp_image.9ba55e09-7823-4aae-8cb2-212c30e8b4111rs2n7dc.img /opt/stack/data/cinder/conversion/vol_upload_kp4g4z88" returned: 0 in 0.594s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:13 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] Image conversion details: src /opt/stack/data/cinder/conversion/a27db357-b40d-4db2-bd33-fd4803e7f285.temp_image.9ba55e09-7823-4aae-8cb2-212c30e8b4111rs2n7dc.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_kp4g4z88 {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:10:13 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 07 06:10:13 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d310b4-25ef-4cc8-9114-a4bab08b3f68]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kp4g4z88 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:13 devstack sudo[86443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kp4g4z88 Apr 07 06:10:13 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:13 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24.e2ca0a2d-32bb-439b-9083-610e2a82616d" returned: 0 in 0.462s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-e2ca0a2d-32bb-439b-9083-610e2a82616d" released by "_delete_snapshot" :: held 2.154s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-658ba698-f7bf-4184-ba40-7c5eccf8ce24" released by "delete_snapshot" :: held 2.171s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:13 devstack cinder-volume[82475]: WARNING cinder.quota [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-771671545 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-771671545, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:10:13 devstack cinder-volume[82475]: WARNING cinder.quota [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-771671545 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-771671545, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:10:13 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Created reservations ['629282a0-4ccf-4ad1-a82f-e0bd5172dece', '286194f7-93a4-475f-925b-fab0b1ef6ac6', '8abe01f7-d600-4128-81ae-29c33cd17f0d', 'f57ae779-9296-4c14-8930-9e3697fc68d3'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:13 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] Created reservations ['c1622198-4da0-4e84-9611-5ff251dd45bb', 'ecc00caf-a4de-4f5e-9a9a-c588459a0693', '346b1b36-6d41-477b-b1dc-fddb183b9428', 'a4abfd91-8067-4694-b940-94897ff5ebcc'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:13 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-240268e1-e185-4d25-b39e-f6ea0bdb64cb tempest-GroupSnapshotsTest-786210802 None] group_snapshot 5951dbb5-e91c-4016-bdd4-98c69fc57b00: deleted successfully Apr 07 06:10:13 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kp4g4z88" returned: 0 in 0.534s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "cinder-quobyte-658ba698-f7bf-4184-ba40-7c5eccf8ce24" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-658ba698-f7bf-4184-ba40-7c5eccf8ce24" acquired by "delete_volume" :: waited 0.015s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:14 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcadda4-6d67-442c-a49e-dbaa4923daa5]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:14 devstack sudo[86449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24 Apr 07 06:10:14 devstack sudo[86449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.857s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] Uploaded volume to glance image-id: 9ba55e09-7823-4aae-8cb2-212c30e8b411. {{(pid=82475) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.113s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1781624493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4224369e16f149ea94ed5612d36070a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:09:56Z,use_quota=True,user_id='a8e466c4fc1d425a93b6072f499ac093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Creating volume 4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:15 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:15 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-61b69e7b-233c-4290-8fd5-5004c6300c88 tempest-VolumesActionsTest-48704033 None] Copy volume to image completed successfully. Apr 07 06:10:15 devstack sudo[86451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 1073741824 Apr 07 06:10:15 devstack sudo[86451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:15 devstack sudo[86449]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24" returned: 0 in 0.604s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:15 devstack sudo[86456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24 Apr 07 06:10:15 devstack sudo[86456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:15 devstack sudo[86451]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 1073741824" returned: 0 in 0.588s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:15 devstack sudo[86462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 Apr 07 06:10:15 devstack sudo[86462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:15 devstack sudo[86456]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-658ba698-f7bf-4184-ba40-7c5eccf8ce24" returned: 0 in 0.466s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-658ba698-f7bf-4184-ba40-7c5eccf8ce24" released by "delete_volume" :: held 1.108s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "cinder-quobyte-78158f7e-11f1-4a73-b834-8ac4b2586d9b" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-78158f7e-11f1-4a73-b834-8ac4b2586d9b" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbd9802-4194-4ceb-87d2-cca16cd761a3]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:16 devstack sudo[86464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b Apr 07 06:10:16 devstack sudo[86464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:16 devstack sudo[86462]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" returned: 0 in 0.506s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.699s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=218aca3b-3446-429d-a958-a8851bf56393,created_at=2026-04-07T04:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1867375529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=218aca3b-3446-429d-a958-a8851bf56393,host='devstack@QuobyteHD#QuobyteHD',id=c73c578a-02ea-44cc-abeb-e4212ee1b535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0c5a3984f64cf59772df115af427bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:07Z,use_quota=True,user_id='2b7f4309b7544fd4a724664092100afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2b460f1-9a98-4c9c-955d-3d756e69c7f3),volume_type_id=a2b460f1-9a98-4c9c-955d-3d756e69c7f3)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Creating volume c73c578a-02ea-44cc-abeb-e4212ee1b535 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:16 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73c578a-02ea-44cc-abeb-e4212ee1b535 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1294d482-d017-48be-ad2e-d5c0f270edb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d3c84c-5d9f-4ef5-a41b-67be10a0fa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:16 devstack sudo[86467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73c578a-02ea-44cc-abeb-e4212ee1b535 1073741824 Apr 07 06:10:16 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:16 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Volume volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 (4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67): created successfully Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d3c84c-5d9f-4ef5-a41b-67be10a0fa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Flow 'volume_create_manager' (5697d8a5-0342-44a9-b147-cae1637a1c5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:16 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d15e214d-e5bc-48fb-8f12-a9ffffbe9d6e tempest-SnapshotsActionsTest-942540758 None] Created volume successfully. Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] Acquiring lock "cinder-a27db357-b40d-4db2-bd33-fd4803e7f285-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] Lock "cinder-a27db357-b40d-4db2-bd33-fd4803e7f285-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] Acquiring lock "cinder-quobyte-a27db357-b40d-4db2-bd33-fd4803e7f285" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] Lock "cinder-quobyte-a27db357-b40d-4db2-bd33-fd4803e7f285" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b560514-c4f2-46eb-a596-e936076b368e]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:16 devstack sudo[86464]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b" returned: 0 in 0.629s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:16 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b Apr 07 06:10:16 devstack sudo[86472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 Apr 07 06:10:16 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:16 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:17 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73c578a-02ea-44cc-abeb-e4212ee1b535 1073741824" returned: 0 in 0.709s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73c578a-02ea-44cc-abeb-e4212ee1b535 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:17 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285" returned: 0 in 0.580s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:17 devstack sudo[86517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73c578a-02ea-44cc-abeb-e4212ee1b535 Apr 07 06:10:17 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:17 devstack sudo[86519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285 Apr 07 06:10:17 devstack sudo[86519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:17 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-78158f7e-11f1-4a73-b834-8ac4b2586d9b" returned: 0 in 0.579s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-78158f7e-11f1-4a73-b834-8ac4b2586d9b" released by "delete_volume" :: held 1.253s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Created reservations ['b401e3ab-6d3a-4018-bb12-9593b41913bd'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:17 devstack cinder-volume[82475]: WARNING cinder.quota [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-771671545 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-771671545, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Created reservations ['dcf54722-5a22-4e8b-8bba-d68917dece24', 'ff584e65-6d85-4e03-ae0b-e42a1f439182', '09732181-b400-44b6-8b57-d4038801eaa6', '180dccae-7a98-4baa-a011-2fd75ab634b3'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Created reservations ['bd21287d-809c-415e-aa5f-47c1c8685a52', 'ad6c64c8-34cb-4d46-8d6d-42a0e285de0a', 'ee7686ec-dc9b-4a44-b9ad-274b619d8c9d', '31f408cb-5013-47a6-883f-b3c5e3efa14f'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-84ab8ada-2686-4ec8-aef8-2c7b75ccdaec tempest-SnapshotsActionsTest-942540758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:17 devstack sudo[86519]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a27db357-b40d-4db2-bd33-fd4803e7f285" returned: 0 in 0.536s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] Lock "cinder-quobyte-a27db357-b40d-4db2-bd33-fd4803e7f285" released by "delete_volume" :: held 1.143s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:17 devstack sudo[86523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:10:17 devstack sudo[86523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] Created reservations ['0df4bf7d-dad7-49b1-90a7-280d69992003', '5eca5ad9-e18f-4637-b595-f489fb0c3f43', '4dedb96e-8fdb-4ebb-9e9f-d0b4c8a5333d', 'f821d883-4abb-4f82-adf0-a5907d2c12fb'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:17 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:17 devstack sudo[86525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73c578a-02ea-44cc-abeb-e4212ee1b535" returned: 0 in 0.684s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:17 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-84ab8ada-2686-4ec8-aef8-2c7b75ccdaec tempest-SnapshotsActionsTest-942540758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.193s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-84ab8ada-2686-4ec8-aef8-2c7b75ccdaec tempest-SnapshotsActionsTest-942540758 None] Creating offline snapshot 291a868e-852b-45e3-a762-987bfa1a7d9a of volume 4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7ecefd-dbe5-495b-9a5c-9c3afe12c19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73c578a-02ea-44cc-abeb-e4212ee1b535', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4c84b4-6940-4b46-8403-c195044bfd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[735ed3dd-0a6c-4818-b363-a455dea7b91b]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-84ab8ada-2686-4ec8-aef8-2c7b75ccdaec tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:17 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Volume volume-c73c578a-02ea-44cc-abeb-e4212ee1b535 (c73c578a-02ea-44cc-abeb-e4212ee1b535): created successfully Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4c84b4-6940-4b46-8403-c195044bfd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:17 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Flow 'volume_create_manager' (6ab04b6c-c100-4b51-a3ce-46edd268b388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:17 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-f1a67674-fd96-4421-a473-bd8cf6cbafb0 tempest-GroupsTest-573961480 None] Created volume successfully. Apr 07 06:10:17 devstack sudo[86527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 Apr 07 06:10:17 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:18 devstack sudo[86523]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.515s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:18 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:18 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-20d58da0-fc6b-4860-8d19-c02d7a52aaec tempest-GroupSnapshotsTest-786210802 None] Delete group completed successfully. Apr 07 06:10:18 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.588s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:18 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:18 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] Deleted volume successfully. Apr 07 06:10:18 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-834b387a-efcd-40bd-b128-78b1a7ab26f1 tempest-VolumesActionsTest-48704033 None] Lock "cinder-a27db357-b40d-4db2-bd33-fd4803e7f285-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:18 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-84ab8ada-2686-4ec8-aef8-2c7b75ccdaec tempest-SnapshotsActionsTest-942540758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" returned: 0 in 0.589s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-84ab8ada-2686-4ec8-aef8-2c7b75ccdaec tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:18 devstack sudo[86534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a 1G Apr 07 06:10:18 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:18 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-f6b6cddd-6875-4b90-9cf3-83c78d60e3b4 tempest-GroupSnapshotsTest-786210802 None] Group tempest-GroupSnapshotsTest-Group-1811433405: creating Apr 07 06:10:18 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-f6b6cddd-6875-4b90-9cf3-83c78d60e3b4 tempest-GroupSnapshotsTest-786210802 None] Group tempest-GroupSnapshotsTest-Group-1811433405: created successfully Apr 07 06:10:18 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-f6b6cddd-6875-4b90-9cf3-83c78d60e3b4 tempest-GroupSnapshotsTest-786210802 None] Create group completed successfully. Apr 07 06:10:18 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-84ab8ada-2686-4ec8-aef8-2c7b75ccdaec tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a 1G" returned: 0 in 0.541s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-84ab8ada-2686-4ec8-aef8-2c7b75ccdaec tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:18 devstack sudo[86539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a Apr 07 06:10:18 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:18 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Flow 'volume_create_manager' (2e58432a-5dcc-4da5-af22-106096cf31c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f3feab-bf63-4ace-b76a-206bd994b7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f3feab-bf63-4ace-b76a-206bd994b7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1265781954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=218aca3b-3446-429d-a958-a8851bf56393,host='devstack@QuobyteHD#QuobyteHD',id=91855b57-63c5-4892-b2dc-d9692e568c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0c5a3984f64cf59772df115af427bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:19Z,use_quota=True,user_id='2b7f4309b7544fd4a724664092100afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2b460f1-9a98-4c9c-955d-3d756e69c7f3),volume_type_id=a2b460f1-9a98-4c9c-955d-3d756e69c7f3)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d023db-edb1-4615-b78b-d68dac01ad0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d023db-edb1-4615-b78b-d68dac01ad0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a439618b-d8be-4129-9e1f-2a3d4152d17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a439618b-d8be-4129-9e1f-2a3d4152d17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91855b57-63c5-4892-b2dc-d9692e568c0e', 'volume_name': 'volume-91855b57-63c5-4892-b2dc-d9692e568c0e', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c232f93a-fd87-41c4-b5b7-20db13b7f70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c232f93a-fd87-41c4-b5b7-20db13b7f70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc396ec-5b5e-4cd7-96b8-4381f19f5cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:19 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Volume 91855b57-63c5-4892-b2dc-d9692e568c0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91855b57-63c5-4892-b2dc-d9692e568c0e', 'volume_size': 1} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:19 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-84ab8ada-2686-4ec8-aef8-2c7b75ccdaec tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a" returned: 0 in 0.492s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:19 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-84ab8ada-2686-4ec8-aef8-2c7b75ccdaec tempest-SnapshotsActionsTest-942540758 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a is being set with open permissions: ugo+rw Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-84ab8ada-2686-4ec8-aef8-2c7b75ccdaec tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:19 devstack sudo[86546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a Apr 07 06:10:19 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Flow 'volume_create_manager' (6b6a17d0-369e-499d-8cec-c9ddbe130679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bc72a8-4a0b-4d60-b930-f6e266a18cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bc72a8-4a0b-4d60-b930-f6e266a18cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1303772006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ce96aa7-1579-4be0-b2fc-912daf8d8213,host='devstack@QuobyteHD#QuobyteHD',id=6c862913-14c4-4390-aba6-98d9831fa886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d096b43038f44349eadd58a7d92c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:20Z,use_quota=True,user_id='a08c2d4f6eaf47adad5dac1cc3efdf1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a66d6e9d-0bd5-43af-b68c-00038f874a19),volume_type_id=a66d6e9d-0bd5-43af-b68c-00038f874a19)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ef9e79-6003-41f4-991e-a4fca8e3d7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ef9e79-6003-41f4-991e-a4fca8e3d7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5441db-30e6-4463-940e-fcc694eb7f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5441db-30e6-4463-940e-fcc694eb7f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c862913-14c4-4390-aba6-98d9831fa886', 'volume_name': 'volume-6c862913-14c4-4390-aba6-98d9831fa886', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7a5d6f-c462-419d-a860-bf373f876833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7a5d6f-c462-419d-a860-bf373f876833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5928f9-d894-4437-b17a-6fe30cfaa2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:19 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Volume 6c862913-14c4-4390-aba6-98d9831fa886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c862913-14c4-4390-aba6-98d9831fa886', 'volume_size': 1} Apr 07 06:10:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:20 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-84ab8ada-2686-4ec8-aef8-2c7b75ccdaec tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a" returned: 0 in 0.605s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-84ab8ada-2686-4ec8-aef8-2c7b75ccdaec tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:20 devstack sudo[86551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.info Apr 07 06:10:20 devstack sudo[86551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:20 devstack sudo[86551]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-84ab8ada-2686-4ec8-aef8-2c7b75ccdaec tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.info" returned: 0 in 0.447s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:20 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-84ab8ada-2686-4ec8-aef8-2c7b75ccdaec tempest-SnapshotsActionsTest-942540758 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.info is being set with open permissions: ugo+rw Apr 07 06:10:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-84ab8ada-2686-4ec8-aef8-2c7b75ccdaec tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:20 devstack sudo[86554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.info Apr 07 06:10:20 devstack sudo[86554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:21 devstack sudo[86554]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-84ab8ada-2686-4ec8-aef8-2c7b75ccdaec tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.info" returned: 0 in 0.556s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-84ab8ada-2686-4ec8-aef8-2c7b75ccdaec tempest-SnapshotsActionsTest-942540758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.318s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.024s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=218aca3b-3446-429d-a958-a8851bf56393,created_at=2026-04-07T04:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1265781954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=218aca3b-3446-429d-a958-a8851bf56393,host='devstack@QuobyteHD#QuobyteHD',id=91855b57-63c5-4892-b2dc-d9692e568c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0c5a3984f64cf59772df115af427bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:19Z,use_quota=True,user_id='2b7f4309b7544fd4a724664092100afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2b460f1-9a98-4c9c-955d-3d756e69c7f3),volume_type_id=a2b460f1-9a98-4c9c-955d-3d756e69c7f3)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Creating volume 91855b57-63c5-4892-b2dc-d9692e568c0e {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:21 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:10:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-91855b57-63c5-4892-b2dc-d9692e568c0e 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:21 devstack sudo[86557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-91855b57-63c5-4892-b2dc-d9692e568c0e 1073741824 Apr 07 06:10:21 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:21 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-84ab8ada-2686-4ec8-aef8-2c7b75ccdaec tempest-SnapshotsActionsTest-942540758 None] Create snapshot completed successfully Apr 07 06:10:21 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-91855b57-63c5-4892-b2dc-d9692e568c0e 1073741824" returned: 0 in 0.739s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-91855b57-63c5-4892-b2dc-d9692e568c0e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:21 devstack sudo[86563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-91855b57-63c5-4892-b2dc-d9692e568c0e Apr 07 06:10:21 devstack sudo[86563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-cd116365-7448-4ab7-8f46-e6f1187b4f6e tempest-SnapshotsActionsTest-942540758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:22 devstack sudo[86563]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-91855b57-63c5-4892-b2dc-d9692e568c0e" returned: 0 in 0.645s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.649s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1ce96aa7-1579-4be0-b2fc-912daf8d8213,created_at=2026-04-07T04:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1303772006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ce96aa7-1579-4be0-b2fc-912daf8d8213,host='devstack@QuobyteHD#QuobyteHD',id=6c862913-14c4-4390-aba6-98d9831fa886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d096b43038f44349eadd58a7d92c2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:20Z,use_quota=True,user_id='a08c2d4f6eaf47adad5dac1cc3efdf1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a66d6e9d-0bd5-43af-b68c-00038f874a19),volume_type_id=a66d6e9d-0bd5-43af-b68c-00038f874a19)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Creating volume 6c862913-14c4-4390-aba6-98d9831fa886 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:22 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:10:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc396ec-5b5e-4cd7-96b8-4381f19f5cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91855b57-63c5-4892-b2dc-d9692e568c0e', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:22 devstack sudo[86566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886 1073741824 Apr 07 06:10:22 devstack sudo[86566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5428a13a-0f23-4dce-8c65-06e7dddfb075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:22 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Volume volume-91855b57-63c5-4892-b2dc-d9692e568c0e (91855b57-63c5-4892-b2dc-d9692e568c0e): created successfully Apr 07 06:10:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5428a13a-0f23-4dce-8c65-06e7dddfb075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Flow 'volume_create_manager' (2e58432a-5dcc-4da5-af22-106096cf31c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:22 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-0ce040a6-afa3-4001-bbc5-25b8628e13ab tempest-GroupsTest-573961480 None] Created volume successfully. Apr 07 06:10:23 devstack sudo[86566]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886 1073741824" returned: 0 in 0.802s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:23 devstack sudo[86571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886 Apr 07 06:10:23 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:23 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-13e13c9e-5c01-460b-818a-57380c7ab3bf tempest-GroupsTest-573961480 None] Update group completed successfully. Apr 07 06:10:23 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886" returned: 0 in 0.523s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:23 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-cd116365-7448-4ab7-8f46-e6f1187b4f6e tempest-SnapshotsActionsTest-942540758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.653s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:23 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-cd116365-7448-4ab7-8f46-e6f1187b4f6e tempest-SnapshotsActionsTest-942540758 None] Creating offline snapshot 10aac065-016a-47e9-b4e8-90001b9922eb of volume 4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:10:23 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[203c4cdf-c870-4a0b-818c-8d18a1341d7b]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cd116365-7448-4ab7-8f46-e6f1187b4f6e tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5928f9-d894-4437-b17a-6fe30cfaa2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c862913-14c4-4390-aba6-98d9831fa886', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c46ab6f-cf4f-40cf-b75b-330e1fb098ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:24 devstack sudo[86574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a Apr 07 06:10:24 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:24 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Volume volume-6c862913-14c4-4390-aba6-98d9831fa886 (6c862913-14c4-4390-aba6-98d9831fa886): created successfully Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c46ab6f-cf4f-40cf-b75b-330e1fb098ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Flow 'volume_create_manager' (6b6a17d0-369e-499d-8cec-c9ddbe130679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:24 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-796659c2-488b-4e57-94d3-bffa0667aa49 tempest-GroupSnapshotsTest-786210802 None] Created volume successfully. Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Flow 'volume_create_manager' (15d22e8a-1a76-4181-bef4-d0fcfbec6d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca380fe1-a613-4071-abc5-05d350ddf468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:24 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] GroupSnapshot 5e0df05a-5097-48a5-9ab8-dadfe5a50fbf: creating. Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca380fe1-a613-4071-abc5-05d350ddf468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-730964537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f82b6d-ed1f-4653-ac96-543cee0b1d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464dd7516640416f853b6cdfc325a9d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:24Z,use_quota=True,user_id='73aa9ec741b84228b935c01351d1be05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42e71a3-c54c-43c3-a289-03b62d77fa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42e71a3-c54c-43c3-a289-03b62d77fa6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192cb3a4-850d-4b69-b578-e17be385cb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192cb3a4-850d-4b69-b578-e17be385cb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8f82b6d-ed1f-4653-ac96-543cee0b1d83', 'volume_name': 'volume-f8f82b6d-ed1f-4653-ac96-543cee0b1d83', 'volume_size': 2}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2217a98b-f89d-4445-ae0c-09a200f16d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2217a98b-f89d-4445-ae0c-09a200f16d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95daf0d1-26f8-46ad-aef8-b8761fd1ae76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:24 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Volume f8f82b6d-ed1f-4653-ac96-543cee0b1d83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8f82b6d-ed1f-4653-ac96-543cee0b1d83', 'volume_size': 2} Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] Group snapshot 5e0df05a-5097-48a5-9ab8-dadfe5a50fbf: creating. {{(pid=82475) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:24 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cd116365-7448-4ab7-8f46-e6f1187b4f6e tempest-SnapshotsActionsTest-942540758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a" returned: 0 in 0.555s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-cd116365-7448-4ab7-8f46-e6f1187b4f6e tempest-SnapshotsActionsTest-942540758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cd116365-7448-4ab7-8f46-e6f1187b4f6e tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:24 devstack sudo[86579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb 1G Apr 07 06:10:24 devstack sudo[86579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:24 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-6ff45107-6271-4ef7-b50a-36c48a6caaf9 tempest-GroupsTest-573961480 None] Update group completed successfully. Apr 07 06:10:24 devstack sudo[86579]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cd116365-7448-4ab7-8f46-e6f1187b4f6e tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb 1G" returned: 0 in 0.501s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cd116365-7448-4ab7-8f46-e6f1187b4f6e tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:25 devstack sudo[86584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb Apr 07 06:10:25 devstack sudo[86584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:25 devstack sudo[86584]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cd116365-7448-4ab7-8f46-e6f1187b4f6e tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb" returned: 0 in 0.434s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:25 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-cd116365-7448-4ab7-8f46-e6f1187b4f6e tempest-SnapshotsActionsTest-942540758 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb is being set with open permissions: ugo+rw Apr 07 06:10:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cd116365-7448-4ab7-8f46-e6f1187b4f6e tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:25 devstack sudo[86589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb Apr 07 06:10:25 devstack sudo[86589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:25 devstack sudo[86589]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cd116365-7448-4ab7-8f46-e6f1187b4f6e tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb" returned: 0 in 0.473s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-cd116365-7448-4ab7-8f46-e6f1187b4f6e tempest-SnapshotsActionsTest-942540758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.497s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:25 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-730964537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f82b6d-ed1f-4653-ac96-543cee0b1d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464dd7516640416f853b6cdfc325a9d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:24Z,use_quota=True,user_id='73aa9ec741b84228b935c01351d1be05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:25 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Creating volume f8f82b6d-ed1f-4653-ac96-543cee0b1d83 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:25 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:25 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:25 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:25 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:10:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f8f82b6d-ed1f-4653-ac96-543cee0b1d83 2147483648 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:25 devstack sudo[86592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f8f82b6d-ed1f-4653-ac96-543cee0b1d83 2147483648 Apr 07 06:10:25 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:25 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-cd116365-7448-4ab7-8f46-e6f1187b4f6e tempest-SnapshotsActionsTest-942540758 None] Create snapshot completed successfully Apr 07 06:10:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Acquiring lock "cinder-quobyte-91855b57-63c5-4892-b2dc-d9692e568c0e" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Lock "cinder-quobyte-91855b57-63c5-4892-b2dc-d9692e568c0e" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:26 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e307b4d-eb12-425f-aac6-3a84a9183e7a]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-91855b57-63c5-4892-b2dc-d9692e568c0e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:26 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-91855b57-63c5-4892-b2dc-d9692e568c0e Apr 07 06:10:26 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:26 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f8f82b6d-ed1f-4653-ac96-543cee0b1d83 2147483648" returned: 0 in 0.569s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f8f82b6d-ed1f-4653-ac96-543cee0b1d83 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:26 devstack sudo[86599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f8f82b6d-ed1f-4653-ac96-543cee0b1d83 Apr 07 06:10:26 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] Acquiring lock "cinder-10aac065-016a-47e9-b4e8-90001b9922eb-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-10aac065-016a-47e9-b4e8-90001b9922eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] Acquiring lock "cinder-quobyte-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-quobyte-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] Acquiring lock "cinder-quobyte-10aac065-016a-47e9-b4e8-90001b9922eb" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-quobyte-10aac065-016a-47e9-b4e8-90001b9922eb" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] Deleting offline snapshot 10aac065-016a-47e9-b4e8-90001b9922eb of volume 4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:10:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] snapshot_file for this snap is: volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:10:26 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddb87f0-4427-47c7-a914-f178ffb3152a]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:26 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-91855b57-63c5-4892-b2dc-d9692e568c0e" returned: 0 in 0.606s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-91855b57-63c5-4892-b2dc-d9692e568c0e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:26 devstack sudo[86604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb Apr 07 06:10:26 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:26 devstack sudo[86606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-91855b57-63c5-4892-b2dc-d9692e568c0e Apr 07 06:10:26 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:27 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f8f82b6d-ed1f-4653-ac96-543cee0b1d83" returned: 0 in 0.484s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.578s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95daf0d1-26f8-46ad-aef8-b8761fd1ae76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8f82b6d-ed1f-4653-ac96-543cee0b1d83', 'volume_size': 2}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ac3f5d-0955-4633-8a99-2e7be948a40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] Creating offline snapshot 41ecf1b8-a1de-4b00-9747-14c685d4f11f of volume 6c862913-14c4-4390-aba6-98d9831fa886 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:10:27 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Volume volume-f8f82b6d-ed1f-4653-ac96-543cee0b1d83 (f8f82b6d-ed1f-4653-ac96-543cee0b1d83): created successfully Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ac3f5d-0955-4633-8a99-2e7be948a40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Flow 'volume_create_manager' (15d22e8a-1a76-4181-bef4-d0fcfbec6d47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3f3dad-6b34-43c2-9508-51bcd086e6db]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:27 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-94854a69-a637-4d63-8c49-17d431bda0a5 tempest-VolumesCloneNegativeTest-231004268 None] Created volume successfully. Apr 07 06:10:27 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-91855b57-63c5-4892-b2dc-d9692e568c0e" returned: 0 in 0.486s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:27 devstack sudo[86612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886 Apr 07 06:10:27 devstack sudo[86612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Lock "cinder-quobyte-91855b57-63c5-4892-b2dc-d9692e568c0e" released by "delete_volume" :: held 1.124s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Acquiring lock "cinder-quobyte-c73c578a-02ea-44cc-abeb-e4212ee1b535" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Lock "cinder-quobyte-c73c578a-02ea-44cc-abeb-e4212ee1b535" acquired by "delete_volume" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[a747b4a5-b52e-4eb9-9b0d-0588fab30ca4]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73c578a-02ea-44cc-abeb-e4212ee1b535 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:27 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb" returned: 0 in 0.606s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bf28c3-8e23-44ff-8f6d-7e19f838e663]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:27 devstack sudo[86615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73c578a-02ea-44cc-abeb-e4212ee1b535 Apr 07 06:10:27 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:27 devstack sudo[86616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a Apr 07 06:10:27 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:27 devstack sudo[86612]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886" returned: 0 in 0.620s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:27 devstack sudo[86622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f 1G Apr 07 06:10:27 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] Acquiring lock "cinder-f8f82b6d-ed1f-4653-ac96-543cee0b1d83-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] Lock "cinder-f8f82b6d-ed1f-4653-ac96-543cee0b1d83-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] Acquiring lock "cinder-quobyte-f8f82b6d-ed1f-4653-ac96-543cee0b1d83" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] Lock "cinder-quobyte-f8f82b6d-ed1f-4653-ac96-543cee0b1d83" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[af52d0ea-72f3-4c82-811a-6616efb07344]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f8f82b6d-ed1f-4653-ac96-543cee0b1d83 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:27 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73c578a-02ea-44cc-abeb-e4212ee1b535" returned: 0 in 0.633s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73c578a-02ea-44cc-abeb-e4212ee1b535 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:27 devstack sudo[86631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73c578a-02ea-44cc-abeb-e4212ee1b535 Apr 07 06:10:27 devstack sudo[86631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:27 devstack sudo[86630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f8f82b6d-ed1f-4653-ac96-543cee0b1d83 Apr 07 06:10:27 devstack sudo[86630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:27 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a" returned: 0 in 0.679s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:10:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:27 devstack sudo[86634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb Apr 07 06:10:27 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:28 devstack sudo[86631]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73c578a-02ea-44cc-abeb-e4212ee1b535" returned: 0 in 0.502s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:28 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f 1G" returned: 0 in 0.680s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c862913-14c4-4390-aba6-98d9831fa886 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Lock "cinder-quobyte-c73c578a-02ea-44cc-abeb-e4212ee1b535" released by "delete_volume" :: held 1.169s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:28 devstack sudo[86646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c862913-14c4-4390-aba6-98d9831fa886 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f Apr 07 06:10:28 devstack sudo[86646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:28 devstack sudo[86630]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f8f82b6d-ed1f-4653-ac96-543cee0b1d83" returned: 0 in 0.594s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f8f82b6d-ed1f-4653-ac96-543cee0b1d83 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:28 devstack sudo[86648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f8f82b6d-ed1f-4653-ac96-543cee0b1d83 Apr 07 06:10:28 devstack sudo[86648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Created reservations ['653b37ce-3943-4e70-8b4a-0f2ea1f65592'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:28 devstack cinder-volume[82475]: WARNING cinder.quota [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1643750699 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1643750699, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:10:28 devstack cinder-volume[82475]: WARNING cinder.quota [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1643750699 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1643750699, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Created reservations ['40b0e9c1-73c9-4f30-b9a3-3f7eb92f3cda', '2a3e1bca-bc20-4a28-bcec-b18ecd8be11e', '1ad89aa0-b5af-4b01-adc8-d6527d24dac0', '997d1fdd-4f3d-4ce8-b8ae-784f3b6a323a'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:28 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb" returned: 0 in 0.598s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:28 devstack sudo[86650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb Apr 07 06:10:28 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Created reservations ['45fc6b68-2c79-417e-bb2b-4a9ca81b11e5', '579d09c3-87c9-4c5c-bee2-4b368907a222', 'c981c69d-831d-4c22-8128-0c96d300c91b', '3b9c18c8-d689-415b-8d13-fa8bc637f3ba'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:28 devstack sudo[86652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:10:28 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:28 devstack sudo[86648]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f8f82b6d-ed1f-4653-ac96-543cee0b1d83" returned: 0 in 0.498s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] Lock "cinder-quobyte-f8f82b6d-ed1f-4653-ac96-543cee0b1d83" released by "delete_volume" :: held 1.120s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:28 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] Created reservations ['03104503-396e-4f31-a4da-2f79facc8dcb', '76e5c290-68d0-4f6c-adef-affc7a4cb679', 'f5437f84-95f2-4346-ac0a-f897c42c8c6a', 'e079b709-35d5-4c67-89a5-23263f7d25e9'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:29 devstack sudo[86646]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:29 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.10aac065-016a-47e9-b4e8-90001b9922eb" returned: 0 in 0.458s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c862913-14c4-4390-aba6-98d9831fa886 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f" returned: 0 in 0.622s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:29 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:29 devstack sudo[86659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f Apr 07 06:10:29 devstack sudo[86659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-quobyte-10aac065-016a-47e9-b4e8-90001b9922eb" released by "_delete_snapshot" :: held 2.451s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-quobyte-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" released by "delete_snapshot" :: held 2.467s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:29 devstack sudo[86661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:10:29 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] Created reservations ['c69117d9-f87e-45cb-8b61-a4f6d0958ebd', '93101cc6-abbc-48d2-8c96-1d705bb8542d', '57cc5293-46ac-4eb9-b551-321a89b13179', 'd6d9bd97-3f37-4e68-8b17-2d416613ee0a'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:29 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] Delete snapshot completed successfully. Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-aa566b5f-ffa3-42fe-8878-717a4f974267 tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-10aac065-016a-47e9-b4e8-90001b9922eb-delete_snapshot" released by "delete_snapshot" :: held 2.581s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:29 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.483s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:29 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-db7d0a54-64fa-476c-aab5-19d57f1f2983 tempest-GroupsTest-573961480 None] Delete group completed successfully. Apr 07 06:10:29 devstack sudo[86659]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f" returned: 0 in 0.447s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:29 devstack sudo[86666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.info Apr 07 06:10:29 devstack sudo[86666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:29 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.536s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:29 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] Deleted volume successfully. Apr 07 06:10:29 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c13992a3-aae1-420f-80b9-b7de70de06eb tempest-VolumesCloneNegativeTest-231004268 None] Lock "cinder-f8f82b6d-ed1f-4653-ac96-543cee0b1d83-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:30 devstack sudo[86666]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.info" returned: 0 in 0.556s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:30 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.info is being set with open permissions: ugo+rw: NotImplementedError Apr 07 06:10:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:30 devstack sudo[86670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.info Apr 07 06:10:30 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4996441f-81cf-4581-9dec-b4053ef8256f tempest-SnapshotsActionsTest-942540758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:30 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.info" returned: 0 in 0.576s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.610s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4996441f-81cf-4581-9dec-b4053ef8256f tempest-SnapshotsActionsTest-942540758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.552s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-4996441f-81cf-4581-9dec-b4053ef8256f tempest-SnapshotsActionsTest-942540758 None] Creating offline snapshot 288054ed-59dd-4384-a994-70d8272a224e of volume 4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:10:30 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d00b3f8-d25b-482d-b912-73b7dc38f7fa]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4996441f-81cf-4581-9dec-b4053ef8256f tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:30 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-6b6cda61-5038-4a4a-a059-f9a34b860e14 tempest-GroupSnapshotsTest-786210802 None] group_snapshot 5e0df05a-5097-48a5-9ab8-dadfe5a50fbf: created successfully Apr 07 06:10:30 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a Apr 07 06:10:30 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:31 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4996441f-81cf-4581-9dec-b4053ef8256f tempest-SnapshotsActionsTest-942540758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a" returned: 0 in 0.675s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-4996441f-81cf-4581-9dec-b4053ef8256f tempest-SnapshotsActionsTest-942540758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:10:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4996441f-81cf-4581-9dec-b4053ef8256f tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:31 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e 1G Apr 07 06:10:31 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:31 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] group_snapshot 5e0df05a-5097-48a5-9ab8-dadfe5a50fbf: deleting Apr 07 06:10:31 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] group_snapshot 5e0df05a-5097-48a5-9ab8-dadfe5a50fbf: deleting {{(pid=82475) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 07 06:10:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "cinder-quobyte-6c862913-14c4-4390-aba6-98d9831fa886" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-6c862913-14c4-4390-aba6-98d9831fa886" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "cinder-quobyte-41ecf1b8-a1de-4b00-9747-14c685d4f11f" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-41ecf1b8-a1de-4b00-9747-14c685d4f11f" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] Deleting offline snapshot 41ecf1b8-a1de-4b00-9747-14c685d4f11f of volume 6c862913-14c4-4390-aba6-98d9831fa886 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:10:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] snapshot_file for this snap is: volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:10:31 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f04d184-861f-40f0-8102-824da7dd89f6]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:32 devstack sudo[86683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f Apr 07 06:10:32 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:32 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4996441f-81cf-4581-9dec-b4053ef8256f tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e 1G" returned: 0 in 0.950s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4996441f-81cf-4581-9dec-b4053ef8256f tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:32 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e Apr 07 06:10:32 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:32 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f" returned: 0 in 0.848s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c862913-14c4-4390-aba6-98d9831fa886(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:10:32 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca6bedd-38fa-46b7-8d7f-d886629401e4]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:32 devstack sudo[86690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886 Apr 07 06:10:32 devstack sudo[86690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:33 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4996441f-81cf-4581-9dec-b4053ef8256f tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e" returned: 0 in 0.758s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:33 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-4996441f-81cf-4581-9dec-b4053ef8256f tempest-SnapshotsActionsTest-942540758 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e is being set with open permissions: ugo+rw Apr 07 06:10:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4996441f-81cf-4581-9dec-b4053ef8256f tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:33 devstack sudo[86695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e Apr 07 06:10:33 devstack sudo[86695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:33 devstack sudo[86690]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886" returned: 0 in 0.866s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:33 devstack sudo[86701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f Apr 07 06:10:33 devstack sudo[86701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:33 devstack sudo[86695]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4996441f-81cf-4581-9dec-b4053ef8256f tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e" returned: 0 in 0.721s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4996441f-81cf-4581-9dec-b4053ef8256f tempest-SnapshotsActionsTest-942540758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.204s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:33 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-4996441f-81cf-4581-9dec-b4053ef8256f tempest-SnapshotsActionsTest-942540758 None] Create snapshot completed successfully Apr 07 06:10:34 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d142ce0f-c4a9-432e-8a91-9d5a51a7ea15 tempest-GroupsV320Test-1829475274 None] Group tempest-GroupsV320Test-Group-1325172829: creating Apr 07 06:10:34 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d142ce0f-c4a9-432e-8a91-9d5a51a7ea15 tempest-GroupsV320Test-1829475274 None] Group tempest-GroupsV320Test-Group-1325172829: created successfully Apr 07 06:10:34 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d142ce0f-c4a9-432e-8a91-9d5a51a7ea15 tempest-GroupsV320Test-1829475274 None] Create group completed successfully. Apr 07 06:10:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] Acquiring lock "cinder-288054ed-59dd-4384-a994-70d8272a224e-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-288054ed-59dd-4384-a994-70d8272a224e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] Acquiring lock "cinder-quobyte-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:34 devstack sudo[86701]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-quobyte-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] Acquiring lock "cinder-quobyte-288054ed-59dd-4384-a994-70d8272a224e" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f" returned: 0 in 0.681s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-quobyte-288054ed-59dd-4384-a994-70d8272a224e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:34 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] Deleting offline snapshot 288054ed-59dd-4384-a994-70d8272a224e of volume 4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:10:34 devstack sudo[86706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f Apr 07 06:10:34 devstack sudo[86706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:34 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] snapshot_file for this snap is: volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:10:34 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ac65cf-b516-4263-9b84-2cdc75144fd8]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:34 devstack sudo[86708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e Apr 07 06:10:34 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:34 devstack sudo[86706]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886.41ecf1b8-a1de-4b00-9747-14c685d4f11f" returned: 0 in 0.484s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-41ecf1b8-a1de-4b00-9747-14c685d4f11f" released by "_delete_snapshot" :: held 2.980s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-6c862913-14c4-4390-aba6-98d9831fa886" released by "delete_snapshot" :: held 2.995s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:34 devstack cinder-volume[82475]: WARNING cinder.quota [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1297164178 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1297164178, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:10:34 devstack cinder-volume[82475]: WARNING cinder.quota [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1297164178 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1297164178, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:10:34 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] Created reservations ['4c7b5298-8a7d-4f36-a15d-34ca4a345549', '1e071dab-0ef4-46c7-b190-b9aed1eb5a00', 'ff695f7b-0630-44cb-b751-6e768210c388', '32a97897-9f70-4914-b2a7-707a30effa4c'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:35 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-5d6db660-1e14-4da3-a7e2-549a79e41d6c tempest-GroupSnapshotsTest-786210802 None] group_snapshot 5e0df05a-5097-48a5-9ab8-dadfe5a50fbf: deleted successfully Apr 07 06:10:35 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e" returned: 0 in 0.655s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9a8d45-d803-462c-a2c5-8ab85666fa98]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:35 devstack sudo[86714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a Apr 07 06:10:35 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Flow 'volume_create_manager' (3fc702ab-7c24-42fb-bb52-d1cd2050c5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8cf6c9e-d22c-48b2-a465-dbc10e9ee717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8cf6c9e-d22c-48b2-a465-dbc10e9ee717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-803788057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f442e48-a15a-4e68-8f0f-ad48769b58c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0fd3c6f7041d407bb425a39020df46cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:35Z,use_quota=True,user_id='c65f0f269244494bb493b89ee0ebbc7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54741d27-7b76-45b9-8f0f-feea4ebbda8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54741d27-7b76-45b9-8f0f-feea4ebbda8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (225bb07c-83ca-432b-b9d9-550b80581df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (225bb07c-83ca-432b-b9d9-550b80581df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f442e48-a15a-4e68-8f0f-ad48769b58c8', 'volume_name': 'volume-2f442e48-a15a-4e68-8f0f-ad48769b58c8', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657b10cf-463d-4bca-8ad5-696d9966c751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657b10cf-463d-4bca-8ad5-696d9966c751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936c78d8-ac57-4ff3-9eca-936572d57b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:35 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Volume 2f442e48-a15a-4e68-8f0f-ad48769b58c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f442e48-a15a-4e68-8f0f-ad48769b58c8', 'volume_size': 1} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-803788057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f442e48-a15a-4e68-8f0f-ad48769b58c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0fd3c6f7041d407bb425a39020df46cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:35Z,use_quota=True,user_id='c65f0f269244494bb493b89ee0ebbc7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Creating volume 2f442e48-a15a-4e68-8f0f-ad48769b58c8 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:35 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2f442e48-a15a-4e68-8f0f-ad48769b58c8 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:35 devstack sudo[86716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2f442e48-a15a-4e68-8f0f-ad48769b58c8 1073741824 Apr 07 06:10:35 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-09562977-43dc-4d04-be10-783dbce5c3ca tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "cinder-quobyte-6c862913-14c4-4390-aba6-98d9831fa886" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-09562977-43dc-4d04-be10-783dbce5c3ca tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-6c862913-14c4-4390-aba6-98d9831fa886" acquired by "delete_volume" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9b742b-a585-4d48-999e-f882b8861a23]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09562977-43dc-4d04-be10-783dbce5c3ca tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:35 devstack sudo[86721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886 Apr 07 06:10:35 devstack sudo[86721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:35 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a" returned: 0 in 0.706s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-3fa833bd-d29f-4cd4-8edd-f33132e58bd5 tempest-GroupsV320Test-1829475274 None] Created reservations ['03fef42d-3aa8-401e-8d16-07f5528877df'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:35 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e Apr 07 06:10:35 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3fa833bd-d29f-4cd4-8edd-f33132e58bd5 tempest-GroupsV320Test-1829475274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3fa833bd-d29f-4cd4-8edd-f33132e58bd5 tempest-GroupsV320Test-1829475274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3fa833bd-d29f-4cd4-8edd-f33132e58bd5 tempest-GroupsV320Test-1829475274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3fa833bd-d29f-4cd4-8edd-f33132e58bd5 tempest-GroupsV320Test-1829475274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3fa833bd-d29f-4cd4-8edd-f33132e58bd5 tempest-GroupsV320Test-1829475274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3fa833bd-d29f-4cd4-8edd-f33132e58bd5 tempest-GroupsV320Test-1829475274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:35 devstack sudo[86725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:10:35 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:36 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2f442e48-a15a-4e68-8f0f-ad48769b58c8 1073741824" returned: 0 in 0.696s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:36 devstack sudo[86721]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09562977-43dc-4d04-be10-783dbce5c3ca tempest-GroupSnapshotsTest-786210802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886" returned: 0 in 0.558s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09562977-43dc-4d04-be10-783dbce5c3ca tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2f442e48-a15a-4e68-8f0f-ad48769b58c8 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:36 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886 Apr 07 06:10:36 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:36 devstack sudo[86737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2f442e48-a15a-4e68-8f0f-ad48769b58c8 Apr 07 06:10:36 devstack sudo[86737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:36 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3fa833bd-d29f-4cd4-8edd-f33132e58bd5 tempest-GroupsV320Test-1829475274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.552s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-3fa833bd-d29f-4cd4-8edd-f33132e58bd5 tempest-GroupsV320Test-1829475274 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:36 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-3fa833bd-d29f-4cd4-8edd-f33132e58bd5 tempest-GroupsV320Test-1829475274 None] Delete group completed successfully. Apr 07 06:10:36 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e" returned: 0 in 0.636s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:36 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e Apr 07 06:10:36 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:36 devstack sudo[86737]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2f442e48-a15a-4e68-8f0f-ad48769b58c8" returned: 0 in 0.485s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936c78d8-ac57-4ff3-9eca-936572d57b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f442e48-a15a-4e68-8f0f-ad48769b58c8', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1eed91-69a9-4c8a-bca6-9a351da61cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:36 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Volume volume-2f442e48-a15a-4e68-8f0f-ad48769b58c8 (2f442e48-a15a-4e68-8f0f-ad48769b58c8): created successfully Apr 07 06:10:36 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1eed91-69a9-4c8a-bca6-9a351da61cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Flow 'volume_create_manager' (3fc702ab-7c24-42fb-bb52-d1cd2050c5f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09562977-43dc-4d04-be10-783dbce5c3ca tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6c862913-14c4-4390-aba6-98d9831fa886" returned: 0 in 0.558s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-09562977-43dc-4d04-be10-783dbce5c3ca tempest-GroupSnapshotsTest-786210802 None] Lock "cinder-quobyte-6c862913-14c4-4390-aba6-98d9831fa886" released by "delete_volume" :: held 1.161s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:36 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-0e006cb7-6320-4efb-8377-4f0e6040c507 tempest-VolumesListTestJSON-1029438113 None] Created volume successfully. Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-09562977-43dc-4d04-be10-783dbce5c3ca tempest-GroupSnapshotsTest-786210802 None] Created reservations ['2d275f83-3a7a-452e-bff3-811b9867505f'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:36 devstack cinder-volume[82475]: WARNING cinder.quota [None req-09562977-43dc-4d04-be10-783dbce5c3ca tempest-GroupSnapshotsTest-786210802 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1297164178 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1297164178, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-09562977-43dc-4d04-be10-783dbce5c3ca tempest-GroupSnapshotsTest-786210802 None] Created reservations ['0e98266e-23d3-48ca-8936-8ad11db8d702', 'd7e94d7b-3cfc-4f06-97fb-f6771200ba4f', 'a3e55a5d-f021-47f3-924b-19da234661a5', 'ac6e0205-0fc4-4abd-ae82-341367e482af'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:36 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.288054ed-59dd-4384-a994-70d8272a224e" returned: 0 in 0.505s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-quobyte-288054ed-59dd-4384-a994-70d8272a224e" released by "_delete_snapshot" :: held 2.568s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:36 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-quobyte-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" released by "delete_snapshot" :: held 2.605s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:37 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] Created reservations ['c29212d2-8e8f-498e-97e1-5489fba9a249', '3bbcb459-a869-4112-bf56-522e03fd20c7', 'ace55986-61f2-4d86-96fb-07491fa664fe', 'a64fd058-bd95-4733-ad73-a356411e2b4f'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:37 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] Delete snapshot completed successfully. Apr 07 06:10:37 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ae800bf6-1094-44a0-9669-a9929e315c86 tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-288054ed-59dd-4384-a994-70d8272a224e-delete_snapshot" released by "delete_snapshot" :: held 2.737s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-09562977-43dc-4d04-be10-783dbce5c3ca tempest-GroupSnapshotsTest-786210802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-09562977-43dc-4d04-be10-783dbce5c3ca tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:37 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-09562977-43dc-4d04-be10-783dbce5c3ca tempest-GroupSnapshotsTest-786210802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:37 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-09562977-43dc-4d04-be10-783dbce5c3ca tempest-GroupSnapshotsTest-786210802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-09562977-43dc-4d04-be10-783dbce5c3ca tempest-GroupSnapshotsTest-786210802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09562977-43dc-4d04-be10-783dbce5c3ca tempest-GroupSnapshotsTest-786210802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:37 devstack sudo[86746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:10:37 devstack sudo[86746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:37 devstack sudo[86746]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09562977-43dc-4d04-be10-783dbce5c3ca tempest-GroupSnapshotsTest-786210802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.548s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:37 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-09562977-43dc-4d04-be10-783dbce5c3ca tempest-GroupSnapshotsTest-786210802 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:37 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-09562977-43dc-4d04-be10-783dbce5c3ca tempest-GroupSnapshotsTest-786210802 None] Delete group completed successfully. Apr 07 06:10:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7f331ed4-5f8b-4098-ab4d-c4953d2ef0b0 tempest-SnapshotsActionsTest-942540758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7f331ed4-5f8b-4098-ab4d-c4953d2ef0b0 tempest-SnapshotsActionsTest-942540758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:37 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-7f331ed4-5f8b-4098-ab4d-c4953d2ef0b0 tempest-SnapshotsActionsTest-942540758 None] Creating offline snapshot f42a5d4e-2af7-4bff-8d65-bb57add94b13 of volume 4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:10:37 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[e401544e-56f9-4385-a9b8-ab28dd68a5d9]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f331ed4-5f8b-4098-ab4d-c4953d2ef0b0 tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:38 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Flow 'volume_create_manager' (6554810a-b8a4-4a8c-a523-a8e4708d451c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c60c4cc-486c-4cb0-b949-9c6d166f4caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:38 devstack sudo[86749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a Apr 07 06:10:38 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c60c4cc-486c-4cb0-b949-9c6d166f4caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1754257430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6bfa116-62fd-422c-92c7-defb586c72d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0fd3c6f7041d407bb425a39020df46cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:38Z,use_quota=True,user_id='c65f0f269244494bb493b89ee0ebbc7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6282a2ae-d8f1-40b4-acce-a6d0fc959f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6282a2ae-d8f1-40b4-acce-a6d0fc959f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484e1295-542d-4ec1-8e74-8f4f427ae574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484e1295-542d-4ec1-8e74-8f4f427ae574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6bfa116-62fd-422c-92c7-defb586c72d9', 'volume_name': 'volume-e6bfa116-62fd-422c-92c7-defb586c72d9', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (755c5cc6-e535-4cbe-b0a7-78b22eeec03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (755c5cc6-e535-4cbe-b0a7-78b22eeec03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7143089-1394-432b-abce-aba6c4ff7ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:38 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Volume e6bfa116-62fd-422c-92c7-defb586c72d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6bfa116-62fd-422c-92c7-defb586c72d9', 'volume_size': 1} Apr 07 06:10:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:38 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f331ed4-5f8b-4098-ab4d-c4953d2ef0b0 tempest-SnapshotsActionsTest-942540758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a" returned: 0 in 0.659s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-7f331ed4-5f8b-4098-ab4d-c4953d2ef0b0 tempest-SnapshotsActionsTest-942540758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:10:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f331ed4-5f8b-4098-ab4d-c4953d2ef0b0 tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:38 devstack sudo[86754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13 1G Apr 07 06:10:38 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:39 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f331ed4-5f8b-4098-ab4d-c4953d2ef0b0 tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13 1G" returned: 0 in 0.700s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f331ed4-5f8b-4098-ab4d-c4953d2ef0b0 tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:39 devstack sudo[86759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13 Apr 07 06:10:39 devstack sudo[86759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:39 devstack sudo[86759]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f331ed4-5f8b-4098-ab4d-c4953d2ef0b0 tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13" returned: 0 in 0.596s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:39 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-7f331ed4-5f8b-4098-ab4d-c4953d2ef0b0 tempest-SnapshotsActionsTest-942540758 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13 is being set with open permissions: ugo+rw Apr 07 06:10:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f331ed4-5f8b-4098-ab4d-c4953d2ef0b0 tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:39 devstack sudo[86765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13 Apr 07 06:10:39 devstack sudo[86765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:40 devstack sudo[86765]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f331ed4-5f8b-4098-ab4d-c4953d2ef0b0 tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13" returned: 0 in 0.617s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7f331ed4-5f8b-4098-ab4d-c4953d2ef0b0 tempest-SnapshotsActionsTest-942540758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.678s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.447s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1754257430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6bfa116-62fd-422c-92c7-defb586c72d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0fd3c6f7041d407bb425a39020df46cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:38Z,use_quota=True,user_id='c65f0f269244494bb493b89ee0ebbc7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Creating volume e6bfa116-62fd-422c-92c7-defb586c72d9 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:40 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:10:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6bfa116-62fd-422c-92c7-defb586c72d9 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:40 devstack sudo[86768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6bfa116-62fd-422c-92c7-defb586c72d9 1073741824 Apr 07 06:10:40 devstack sudo[86768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:40 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-7f331ed4-5f8b-4098-ab4d-c4953d2ef0b0 tempest-SnapshotsActionsTest-942540758 None] Create snapshot completed successfully Apr 07 06:10:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] Acquiring lock "cinder-f42a5d4e-2af7-4bff-8d65-bb57add94b13-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-f42a5d4e-2af7-4bff-8d65-bb57add94b13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] Acquiring lock "cinder-quobyte-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-quobyte-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] Acquiring lock "cinder-quobyte-f42a5d4e-2af7-4bff-8d65-bb57add94b13" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-quobyte-f42a5d4e-2af7-4bff-8d65-bb57add94b13" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] Deleting offline snapshot f42a5d4e-2af7-4bff-8d65-bb57add94b13 of volume 4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:10:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] snapshot_file for this snap is: volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:10:41 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fa0375-b1ee-4957-8d27-2a6f05021697]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:41 devstack sudo[86768]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6bfa116-62fd-422c-92c7-defb586c72d9 1073741824" returned: 0 in 0.677s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6bfa116-62fd-422c-92c7-defb586c72d9 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:41 devstack sudo[86774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6bfa116-62fd-422c-92c7-defb586c72d9 Apr 07 06:10:41 devstack sudo[86774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:41 devstack sudo[86773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13 Apr 07 06:10:41 devstack sudo[86773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:41 devstack sudo[86773]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13" returned: 0 in 0.642s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:10:41 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[00339ae9-f35c-4e38-9654-f19a2765128a]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:41 devstack sudo[86781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a Apr 07 06:10:41 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:42 devstack sudo[86774]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6bfa116-62fd-422c-92c7-defb586c72d9" returned: 0 in 0.726s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7143089-1394-432b-abce-aba6c4ff7ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6bfa116-62fd-422c-92c7-defb586c72d9', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378c6608-ddb1-411e-aec3-18b376d02c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:42 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Volume volume-e6bfa116-62fd-422c-92c7-defb586c72d9 (e6bfa116-62fd-422c-92c7-defb586c72d9): created successfully Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378c6608-ddb1-411e-aec3-18b376d02c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Flow 'volume_create_manager' (6554810a-b8a4-4a8c-a523-a8e4708d451c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:42 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-032c3ec3-0934-47fd-9270-57988757aa14 tempest-VolumesListTestJSON-1029438113 None] Created volume successfully. Apr 07 06:10:42 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a" returned: 0 in 0.563s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:42 devstack sudo[86786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13 Apr 07 06:10:42 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Flow 'volume_create_manager' (7d1b18e3-052f-426c-b229-375b6152d7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0eebacb-1bc6-48a5-966f-c78992ac2fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0eebacb-1bc6-48a5-966f-c78992ac2fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-378727443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f09254-e878-4c0a-8825-541778b1c4fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0fd3c6f7041d407bb425a39020df46cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:43Z,use_quota=True,user_id='c65f0f269244494bb493b89ee0ebbc7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d8202f-c799-4a2e-9fbd-0a5638147a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d8202f-c799-4a2e-9fbd-0a5638147a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3679ce1-8470-4b83-a09e-1793945f77da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3679ce1-8470-4b83-a09e-1793945f77da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33f09254-e878-4c0a-8825-541778b1c4fc', 'volume_name': 'volume-33f09254-e878-4c0a-8825-541778b1c4fc', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c6013d-db79-4ffc-ac1f-b2b53bc90a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c6013d-db79-4ffc-ac1f-b2b53bc90a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e50b233-16bc-4a71-ad5f-6661796a4c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:42 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Volume 33f09254-e878-4c0a-8825-541778b1c4fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33f09254-e878-4c0a-8825-541778b1c4fc', 'volume_size': 1} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-378727443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f09254-e878-4c0a-8825-541778b1c4fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0fd3c6f7041d407bb425a39020df46cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:43Z,use_quota=True,user_id='c65f0f269244494bb493b89ee0ebbc7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Creating volume 33f09254-e878-4c0a-8825-541778b1c4fc {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:42 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:10:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-33f09254-e878-4c0a-8825-541778b1c4fc 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:42 devstack sudo[86788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-33f09254-e878-4c0a-8825-541778b1c4fc 1073741824 Apr 07 06:10:42 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:43 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13" returned: 0 in 0.637s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:43 devstack sudo[86793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13 Apr 07 06:10:43 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:43 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-33f09254-e878-4c0a-8825-541778b1c4fc 1073741824" returned: 0 in 0.791s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-33f09254-e878-4c0a-8825-541778b1c4fc {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:43 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-33f09254-e878-4c0a-8825-541778b1c4fc Apr 07 06:10:43 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:43 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.f42a5d4e-2af7-4bff-8d65-bb57add94b13" returned: 0 in 0.729s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-quobyte-f42a5d4e-2af7-4bff-8d65-bb57add94b13" released by "_delete_snapshot" :: held 2.672s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-quobyte-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" released by "delete_snapshot" :: held 2.698s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:43 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] Created reservations ['1b87f66e-5261-4f33-adbd-1db9eb035217', 'ac5e2b26-9dfa-437a-a7c8-3522eeca3dbe', '557bc7df-2591-4aac-aa6e-87e5cba8dd4e', 'e5e71cd6-c18d-4b6d-834f-dd32cc73eab5'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:44 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] Delete snapshot completed successfully. Apr 07 06:10:44 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ffdc7fca-9e61-4247-9b9c-3432eb91369a tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-f42a5d4e-2af7-4bff-8d65-bb57add94b13-delete_snapshot" released by "delete_snapshot" :: held 2.888s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:44 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-33f09254-e878-4c0a-8825-541778b1c4fc" returned: 0 in 0.636s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:44 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:44 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e50b233-16bc-4a71-ad5f-6661796a4c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33f09254-e878-4c0a-8825-541778b1c4fc', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:44 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80cc7530-12b2-4a84-b54c-dfe338163ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:44 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Volume volume-33f09254-e878-4c0a-8825-541778b1c4fc (33f09254-e878-4c0a-8825-541778b1c4fc): created successfully Apr 07 06:10:44 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80cc7530-12b2-4a84-b54c-dfe338163ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:44 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Flow 'volume_create_manager' (7d1b18e3-052f-426c-b229-375b6152d7ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:44 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-7d93f2e5-a6e3-47cc-a109-95aa53626e52 tempest-VolumesListTestJSON-1029438113 None] Created volume successfully. Apr 07 06:10:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a7c5f8ec-ccf1-4094-9c2a-45637055f6bd tempest-SnapshotsActionsTest-942540758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a7c5f8ec-ccf1-4094-9c2a-45637055f6bd tempest-SnapshotsActionsTest-942540758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:44 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-a7c5f8ec-ccf1-4094-9c2a-45637055f6bd tempest-SnapshotsActionsTest-942540758 None] Creating offline snapshot d643c9d0-beeb-4bdc-b0dc-67e1ca665955 of volume 4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:10:44 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b969eb-4e7c-4ea5-8222-975b0b0f9fea]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a7c5f8ec-ccf1-4094-9c2a-45637055f6bd tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:44 devstack sudo[86802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a Apr 07 06:10:44 devstack sudo[86802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:45 devstack sudo[86802]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a7c5f8ec-ccf1-4094-9c2a-45637055f6bd tempest-SnapshotsActionsTest-942540758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a" returned: 0 in 0.637s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:45 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-a7c5f8ec-ccf1-4094-9c2a-45637055f6bd tempest-SnapshotsActionsTest-942540758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:10:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a7c5f8ec-ccf1-4094-9c2a-45637055f6bd tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:45 devstack sudo[86807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955 1G Apr 07 06:10:45 devstack sudo[86807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:46 devstack sudo[86807]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a7c5f8ec-ccf1-4094-9c2a-45637055f6bd tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955 1G" returned: 0 in 0.708s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a7c5f8ec-ccf1-4094-9c2a-45637055f6bd tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:46 devstack sudo[86812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955 Apr 07 06:10:46 devstack sudo[86812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:46 devstack sudo[86812]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a7c5f8ec-ccf1-4094-9c2a-45637055f6bd tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955" returned: 0 in 0.594s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:46 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-a7c5f8ec-ccf1-4094-9c2a-45637055f6bd tempest-SnapshotsActionsTest-942540758 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955 is being set with open permissions: ugo+rw Apr 07 06:10:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a7c5f8ec-ccf1-4094-9c2a-45637055f6bd tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:46 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955 Apr 07 06:10:46 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:47 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a7c5f8ec-ccf1-4094-9c2a-45637055f6bd tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955" returned: 0 in 0.579s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a7c5f8ec-ccf1-4094-9c2a-45637055f6bd tempest-SnapshotsActionsTest-942540758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.603s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:47 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-a7c5f8ec-ccf1-4094-9c2a-45637055f6bd tempest-SnapshotsActionsTest-942540758 None] Create snapshot completed successfully Apr 07 06:10:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] Acquiring lock "cinder-33f09254-e878-4c0a-8825-541778b1c4fc-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] Lock "cinder-33f09254-e878-4c0a-8825-541778b1c4fc-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] Acquiring lock "cinder-quobyte-33f09254-e878-4c0a-8825-541778b1c4fc" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] Lock "cinder-quobyte-33f09254-e878-4c0a-8825-541778b1c4fc" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:47 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[815200bc-8ee3-4749-ada1-7ec926e93ae5]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-33f09254-e878-4c0a-8825-541778b1c4fc {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] Acquiring lock "cinder-d643c9d0-beeb-4bdc-b0dc-67e1ca665955-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-d643c9d0-beeb-4bdc-b0dc-67e1ca665955-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] Acquiring lock "cinder-quobyte-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:47 devstack sudo[86820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-33f09254-e878-4c0a-8825-541778b1c4fc Apr 07 06:10:47 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-quobyte-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] Acquiring lock "cinder-quobyte-d643c9d0-beeb-4bdc-b0dc-67e1ca665955" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-quobyte-d643c9d0-beeb-4bdc-b0dc-67e1ca665955" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:47 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] Deleting offline snapshot d643c9d0-beeb-4bdc-b0dc-67e1ca665955 of volume 4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:10:47 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] snapshot_file for this snap is: volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:10:47 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8d4bc3-5045-47c3-91f9-9fccf06227ef]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:48 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955 Apr 07 06:10:48 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Flow 'volume_create_manager' (37cecfe1-9560-4506-84c1-7250e9e2055b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad7e5cb-41d8-483b-8f9e-ce9bc17c0d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad7e5cb-41d8-483b-8f9e-ce9bc17c0d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-176168762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8cde70-e98a-43e7-a486-51b96b55b411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c97b8d2aebfb4d41b70be13467167c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:48Z,use_quota=True,user_id='1be362cb2940438abe43f4f7dc93cb51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878b3b69-cef3-40a4-a4ff-4174f16fb267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878b3b69-cef3-40a4-a4ff-4174f16fb267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff43d83-e2cb-41e6-a361-d3835bad8c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff43d83-e2cb-41e6-a361-d3835bad8c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb8cde70-e98a-43e7-a486-51b96b55b411', 'volume_name': 'volume-fb8cde70-e98a-43e7-a486-51b96b55b411', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b8f2d8-e479-4689-8c38-33aa9f8a840b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:48 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b8f2d8-e479-4689-8c38-33aa9f8a840b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea09369-c8f5-4739-a697-13cddae368fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:48 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Volume fb8cde70-e98a-43e7-a486-51b96b55b411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb8cde70-e98a-43e7-a486-51b96b55b411', 'volume_size': 1} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-176168762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8cde70-e98a-43e7-a486-51b96b55b411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c97b8d2aebfb4d41b70be13467167c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:48Z,use_quota=True,user_id='1be362cb2940438abe43f4f7dc93cb51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Creating volume fb8cde70-e98a-43e7-a486-51b96b55b411 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:48 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fb8cde70-e98a-43e7-a486-51b96b55b411 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-33f09254-e878-4c0a-8825-541778b1c4fc" returned: 0 in 0.693s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-33f09254-e878-4c0a-8825-541778b1c4fc {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:48 devstack sudo[86830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fb8cde70-e98a-43e7-a486-51b96b55b411 1073741824 Apr 07 06:10:48 devstack sudo[86830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:48 devstack sudo[86831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-33f09254-e878-4c0a-8825-541778b1c4fc Apr 07 06:10:48 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:48 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955" returned: 0 in 0.661s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55009c2-0154-42a8-bfe1-4a9103d7a97c]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:48 devstack sudo[86834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a Apr 07 06:10:48 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:49 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-33f09254-e878-4c0a-8825-541778b1c4fc" returned: 0 in 0.553s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] Lock "cinder-quobyte-33f09254-e878-4c0a-8825-541778b1c4fc" released by "delete_volume" :: held 1.296s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] Created reservations ['4df5b8a2-e891-4489-ac91-b908244f067f', '9a91eb61-5e73-443f-911e-7b6c979fe582', 'e533760c-7160-4746-9512-21fc25c1f244', '163784d8-b64b-4a77-9f00-a376c353e836'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:49 devstack sudo[86830]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fb8cde70-e98a-43e7-a486-51b96b55b411 1073741824" returned: 0 in 0.677s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:49 devstack sudo[86843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:10:49 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fb8cde70-e98a-43e7-a486-51b96b55b411 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:49 devstack sudo[86845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fb8cde70-e98a-43e7-a486-51b96b55b411 Apr 07 06:10:49 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:49 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a" returned: 0 in 0.671s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:49 devstack sudo[86847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955 Apr 07 06:10:49 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:49 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.457s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:49 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] Deleted volume successfully. Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f817b65e-f1e0-4727-b6da-ae37bdc77817 tempest-VolumesListTestJSON-1029438113 None] Lock "cinder-33f09254-e878-4c0a-8825-541778b1c4fc-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:49 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fb8cde70-e98a-43e7-a486-51b96b55b411" returned: 0 in 0.503s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea09369-c8f5-4739-a697-13cddae368fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb8cde70-e98a-43e7-a486-51b96b55b411', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96769976-296e-4fbd-a132-d876d7a69dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:49 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Volume volume-fb8cde70-e98a-43e7-a486-51b96b55b411 (fb8cde70-e98a-43e7-a486-51b96b55b411): created successfully Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96769976-296e-4fbd-a132-d876d7a69dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Flow 'volume_create_manager' (37cecfe1-9560-4506-84c1-7250e9e2055b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:49 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-8376b263-eb4b-45a5-9d8c-f854dcade7ab tempest-VolumeQuotasAdminTestJSON-703644928 None] Created volume successfully. Apr 07 06:10:49 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955" returned: 0 in 0.619s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:49 devstack sudo[86855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955 Apr 07 06:10:49 devstack sudo[86855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] Acquiring lock "cinder-e6bfa116-62fd-422c-92c7-defb586c72d9-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] Lock "cinder-e6bfa116-62fd-422c-92c7-defb586c72d9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] Acquiring lock "cinder-quobyte-e6bfa116-62fd-422c-92c7-defb586c72d9" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] Lock "cinder-quobyte-e6bfa116-62fd-422c-92c7-defb586c72d9" acquired by "delete_volume" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:50 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[5084b03a-3581-41e1-acbc-a38a741ea473]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6bfa116-62fd-422c-92c7-defb586c72d9 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:50 devstack sudo[86857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6bfa116-62fd-422c-92c7-defb586c72d9 Apr 07 06:10:50 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:50 devstack sudo[86855]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.d643c9d0-beeb-4bdc-b0dc-67e1ca665955" returned: 0 in 0.525s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-quobyte-d643c9d0-beeb-4bdc-b0dc-67e1ca665955" released by "_delete_snapshot" :: held 2.569s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-quobyte-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" released by "delete_snapshot" :: held 2.584s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:50 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] Created reservations ['678afd9e-9e1a-4c1a-8907-2e5807bbe507', 'b18d9811-3eb7-4474-86af-607aa8066a1a', 'a14f7d72-d7a8-4171-9483-9d0e7c14f936', 'fce0709d-0c3f-450a-b245-93d8bb87c09f'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:50 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] Delete snapshot completed successfully. Apr 07 06:10:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] Acquiring lock "cinder-fb8cde70-e98a-43e7-a486-51b96b55b411-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ce54bb5e-1af5-46e9-bce0-aa7a9df6ccb4 tempest-SnapshotsActionsTest-1834283306 None] Lock "cinder-d643c9d0-beeb-4bdc-b0dc-67e1ca665955-delete_snapshot" released by "delete_snapshot" :: held 2.750s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] Lock "cinder-fb8cde70-e98a-43e7-a486-51b96b55b411-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] Acquiring lock "cinder-quobyte-fb8cde70-e98a-43e7-a486-51b96b55b411" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] Lock "cinder-quobyte-fb8cde70-e98a-43e7-a486-51b96b55b411" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:50 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[583d0a8d-6c14-49ed-a226-da7be282d1ec]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fb8cde70-e98a-43e7-a486-51b96b55b411 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:50 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6bfa116-62fd-422c-92c7-defb586c72d9" returned: 0 in 0.629s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6bfa116-62fd-422c-92c7-defb586c72d9 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:50 devstack sudo[86864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6bfa116-62fd-422c-92c7-defb586c72d9 Apr 07 06:10:50 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:50 devstack sudo[86863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fb8cde70-e98a-43e7-a486-51b96b55b411 Apr 07 06:10:50 devstack sudo[86863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:51 devstack sudo[86863]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fb8cde70-e98a-43e7-a486-51b96b55b411" returned: 0 in 0.629s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fb8cde70-e98a-43e7-a486-51b96b55b411 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:51 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6bfa116-62fd-422c-92c7-defb586c72d9" returned: 0 in 0.623s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:51 devstack sudo[86871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fb8cde70-e98a-43e7-a486-51b96b55b411 Apr 07 06:10:51 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] Lock "cinder-quobyte-e6bfa116-62fd-422c-92c7-defb586c72d9" released by "delete_volume" :: held 1.281s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] Created reservations ['33a1a9b0-fe87-49d6-9fba-50d5fe96273b', '89d44399-db2f-4b91-a6d7-f2fad1a38ad0', '96dc99bb-5bc2-4989-a981-60bfda38ee2d', '96846899-8d37-4542-bad6-b84d4f008b44'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] Acquiring lock "cinder-291a868e-852b-45e3-a762-987bfa1a7d9a-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] Lock "cinder-291a868e-852b-45e3-a762-987bfa1a7d9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:51 devstack sudo[86873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] Acquiring lock "cinder-quobyte-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] Lock "cinder-quobyte-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] Acquiring lock "cinder-quobyte-291a868e-852b-45e3-a762-987bfa1a7d9a" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:51 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] Lock "cinder-quobyte-291a868e-852b-45e3-a762-987bfa1a7d9a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] Deleting offline snapshot 291a868e-852b-45e3-a762-987bfa1a7d9a of volume 4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] snapshot_file for this snap is: volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0fc0ea-d5e6-44c3-8cec-fa53ecf68e39]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:51 devstack sudo[86875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a Apr 07 06:10:51 devstack sudo[86875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG oslo_service.periodic_task [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82475) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:51 devstack sudo[86877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:10:51 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:52 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fb8cde70-e98a-43e7-a486-51b96b55b411" returned: 0 in 0.682s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] Lock "cinder-quobyte-fb8cde70-e98a-43e7-a486-51b96b55b411" released by "delete_volume" :: held 1.339s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:52 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.603s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:52 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] Deleted volume successfully. Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] Created reservations ['fb3e679d-cea4-4f78-addf-4a2707ea7931', '1940037d-6bad-4aab-b9d7-f0d4593aabbb', 'aa0567ef-9f91-4438-a2a9-05c7d41d3b3a', '88674074-4d23-43ec-83df-2255761e24b1'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-809e62cd-9cb0-4783-87b4-a518ec56783e tempest-VolumesListTestJSON-1029438113 None] Lock "cinder-e6bfa116-62fd-422c-92c7-defb586c72d9-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:52 devstack sudo[86884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:10:52 devstack sudo[86884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:52 devstack sudo[86875]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a" returned: 0 in 0.699s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fe7d09-25d4-4a48-86ec-d0e0cfa97d70]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:52 devstack sudo[86887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 Apr 07 06:10:52 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] Acquiring lock "cinder-2f442e48-a15a-4e68-8f0f-ad48769b58c8-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] Lock "cinder-2f442e48-a15a-4e68-8f0f-ad48769b58c8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] Acquiring lock "cinder-quobyte-2f442e48-a15a-4e68-8f0f-ad48769b58c8" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:52 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] Lock "cinder-quobyte-2f442e48-a15a-4e68-8f0f-ad48769b58c8" acquired by "delete_volume" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.672s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf1c582-7f1b-48bf-ad14-6a34d36273d7]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2f442e48-a15a-4e68-8f0f-ad48769b58c8 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:52 devstack sudo[86889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2f442e48-a15a-4e68-8f0f-ad48769b58c8 Apr 07 06:10:52 devstack sudo[86889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:52 devstack sudo[86884]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.532s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:52 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] Deleted volume successfully. Apr 07 06:10:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a129f84f-9f21-46b8-b68c-be5169e9719d tempest-VolumeQuotasAdminTestJSON-703644928 None] Lock "cinder-fb8cde70-e98a-43e7-a486-51b96b55b411-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:53 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" returned: 0 in 0.749s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:53 devstack sudo[86897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a Apr 07 06:10:53 devstack sudo[86897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:53 devstack sudo[86889]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2f442e48-a15a-4e68-8f0f-ad48769b58c8" returned: 0 in 0.724s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2f442e48-a15a-4e68-8f0f-ad48769b58c8 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:53 devstack sudo[86900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2f442e48-a15a-4e68-8f0f-ad48769b58c8 Apr 07 06:10:53 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Flow 'volume_create_manager' (b5295c13-fe4d-4a52-b9f7-85b8251e5c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08d984f-ab6c-454a-b464-cfae1ba3e0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08d984f-ab6c-454a-b464-cfae1ba3e0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-177371719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e49d171e-8c6a-4d51-8be3-2717078e3967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c97b8d2aebfb4d41b70be13467167c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:53Z,use_quota=True,user_id='1be362cb2940438abe43f4f7dc93cb51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fdad00-b68f-44a0-844d-1c7f576d7d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fdad00-b68f-44a0-844d-1c7f576d7d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b086cda2-7a15-4552-8180-2b6cd2f26be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b086cda2-7a15-4552-8180-2b6cd2f26be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e49d171e-8c6a-4d51-8be3-2717078e3967', 'volume_name': 'volume-e49d171e-8c6a-4d51-8be3-2717078e3967', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b958d342-da93-43a6-a516-d3bcdbe379ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b958d342-da93-43a6-a516-d3bcdbe379ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27758b20-4535-4db0-a5a8-62e172695fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:53 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Volume e49d171e-8c6a-4d51-8be3-2717078e3967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e49d171e-8c6a-4d51-8be3-2717078e3967', 'volume_size': 1} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-177371719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e49d171e-8c6a-4d51-8be3-2717078e3967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c97b8d2aebfb4d41b70be13467167c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:53Z,use_quota=True,user_id='1be362cb2940438abe43f4f7dc93cb51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Creating volume e49d171e-8c6a-4d51-8be3-2717078e3967 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:53 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e49d171e-8c6a-4d51-8be3-2717078e3967 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:53 devstack sudo[86902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e49d171e-8c6a-4d51-8be3-2717078e3967 1073741824 Apr 07 06:10:53 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:53 devstack sudo[86897]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a" returned: 0 in 0.590s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:53 devstack sudo[86908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a Apr 07 06:10:53 devstack sudo[86908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:53 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2f442e48-a15a-4e68-8f0f-ad48769b58c8" returned: 0 in 0.556s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] Lock "cinder-quobyte-2f442e48-a15a-4e68-8f0f-ad48769b58c8" released by "delete_volume" :: held 1.321s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] Created reservations ['f0da5d11-af1f-4f48-840d-d1a843139a83', '31d87ae0-e621-4a4f-a7f9-ba773ac24107', '62d6c560-be7e-43e0-baf7-ae6608e6999d', 'd97680cb-9028-4cc3-b887-34311e04a0f1'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:54 devstack sudo[86913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:10:54 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:54 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e49d171e-8c6a-4d51-8be3-2717078e3967 1073741824" returned: 0 in 0.693s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e49d171e-8c6a-4d51-8be3-2717078e3967 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:54 devstack sudo[86916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e49d171e-8c6a-4d51-8be3-2717078e3967 Apr 07 06:10:54 devstack sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:54 devstack sudo[86908]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67.291a868e-852b-45e3-a762-987bfa1a7d9a" returned: 0 in 0.525s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] Lock "cinder-quobyte-291a868e-852b-45e3-a762-987bfa1a7d9a" released by "_delete_snapshot" :: held 2.651s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] Lock "cinder-quobyte-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" released by "delete_snapshot" :: held 2.666s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] Created reservations ['c59f6a7c-cd10-4ee0-aace-1d2232ae5478', '1c34415e-63ae-4534-834f-4f3e23f17290', '795fd668-6f2c-4b27-8140-0fdaf2c04a0c', 'ad0de61d-49f8-4c33-bbd5-ab0c8510b15d'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:54 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] Delete snapshot completed successfully. Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a3e343c2-0d67-406e-8c8a-8b232a4a94bb tempest-SnapshotsActionsTest-942540758 None] Lock "cinder-291a868e-852b-45e3-a762-987bfa1a7d9a-delete_snapshot" released by "delete_snapshot" :: held 2.783s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:54 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.561s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:54 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] Deleted volume successfully. Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3f0800ea-484a-47da-b22d-143514f9f28e tempest-VolumesListTestJSON-1029438113 None] Lock "cinder-2f442e48-a15a-4e68-8f0f-ad48769b58c8-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:54 devstack sudo[86916]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e49d171e-8c6a-4d51-8be3-2717078e3967" returned: 0 in 0.644s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27758b20-4535-4db0-a5a8-62e172695fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e49d171e-8c6a-4d51-8be3-2717078e3967', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2819778-6074-42b4-9f43-89b5a84acebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:54 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Volume volume-e49d171e-8c6a-4d51-8be3-2717078e3967 (e49d171e-8c6a-4d51-8be3-2717078e3967): created successfully Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2819778-6074-42b4-9f43-89b5a84acebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Flow 'volume_create_manager' (b5295c13-fe4d-4a52-b9f7-85b8251e5c8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:54 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d49ad496-4275-4dd1-9cd2-190fff28aa7b tempest-VolumeQuotasAdminTestJSON-703644928 None] Created volume successfully. Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] Acquiring lock "cinder-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] Lock "cinder-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] Acquiring lock "cinder-quobyte-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] Lock "cinder-quobyte-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ae4707-7538-4e82-9edc-8bd072ed1e1a]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:55 devstack sudo[86920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 Apr 07 06:10:55 devstack sudo[86920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Flow 'volume_create_manager' (cc442677-521a-4aec-b8bb-22b0ffb4adf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af22e6f6-7af0-4296-9f17-5c3d9d47b9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af22e6f6-7af0-4296-9f17-5c3d9d47b9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-956679695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efe5709-0668-41d8-8a3a-88816ffb7ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15057359a1d0493b95b0f918b576daa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:55Z,use_quota=True,user_id='0aff940d7a3643e2af34c57740d2686c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d1d34bc-f1c8-44d9-a4bc-4c6dbec94be4),volume_type_id=2d1d34bc-f1c8-44d9-a4bc-4c6dbec94be4)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db001469-077e-4f8c-b90f-71a5d8a89f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db001469-077e-4f8c-b90f-71a5d8a89f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0dcfee-5561-48ea-821c-e5ede5fc4ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0dcfee-5561-48ea-821c-e5ede5fc4ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8efe5709-0668-41d8-8a3a-88816ffb7ee7', 'volume_name': 'volume-8efe5709-0668-41d8-8a3a-88816ffb7ee7', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f17c0e-3888-42bb-8d0b-be78cc5d8be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f17c0e-3888-42bb-8d0b-be78cc5d8be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f1f1ca-da80-48e6-a3e9-4524668859ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:55 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Volume 8efe5709-0668-41d8-8a3a-88816ffb7ee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8efe5709-0668-41d8-8a3a-88816ffb7ee7', 'volume_size': 1} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-956679695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efe5709-0668-41d8-8a3a-88816ffb7ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15057359a1d0493b95b0f918b576daa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:10:55Z,use_quota=True,user_id='0aff940d7a3643e2af34c57740d2686c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d1d34bc-f1c8-44d9-a4bc-4c6dbec94be4),volume_type_id=2d1d34bc-f1c8-44d9-a4bc-4c6dbec94be4)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Creating volume 8efe5709-0668-41d8-8a3a-88816ffb7ee7 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:10:55 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8efe5709-0668-41d8-8a3a-88816ffb7ee7 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:55 devstack sudo[86922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8efe5709-0668-41d8-8a3a-88816ffb7ee7 1073741824 Apr 07 06:10:55 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:55 devstack sudo[86920]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" returned: 0 in 0.799s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:55 devstack sudo[86927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67 Apr 07 06:10:55 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:56 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8efe5709-0668-41d8-8a3a-88816ffb7ee7 1073741824" returned: 0 in 0.966s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8efe5709-0668-41d8-8a3a-88816ffb7ee7 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:56 devstack sudo[86932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8efe5709-0668-41d8-8a3a-88816ffb7ee7 Apr 07 06:10:56 devstack sudo[86932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:56 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-a73a12c1-43bb-4a94-8d54-d87d0f8afc80 tempest-VolumeQuotasAdminTestJSON-1745483587 None] Transfer volume completed successfully. Apr 07 06:10:56 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" returned: 0 in 0.569s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] Lock "cinder-quobyte-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67" released by "delete_volume" :: held 1.426s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:56 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] Created reservations ['2fb11e50-38b8-4f90-b083-0c4aec928bba', '3fc4bd1e-66c4-4607-a1f1-e89af5c8de30', '518f34ec-be34-4e44-ae58-0e0ebfe6f9bc', 'd7f48c05-3538-43f4-9bdb-556b741548db'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:56 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:56 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:56 devstack sudo[86935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:10:56 devstack sudo[86935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:56 devstack sudo[86932]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8efe5709-0668-41d8-8a3a-88816ffb7ee7" returned: 0 in 0.474s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:56 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:10:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f1f1ca-da80-48e6-a3e9-4524668859ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8efe5709-0668-41d8-8a3a-88816ffb7ee7', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2223c10a-57ff-41a6-aff0-5c500c356f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:10:56 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Volume volume-8efe5709-0668-41d8-8a3a-88816ffb7ee7 (8efe5709-0668-41d8-8a3a-88816ffb7ee7): created successfully Apr 07 06:10:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2223c10a-57ff-41a6-aff0-5c500c356f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:10:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Flow 'volume_create_manager' (cc442677-521a-4aec-b8bb-22b0ffb4adf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:10:56 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-2008b360-8bdd-4603-a314-a2ae52fb5428 tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Created volume successfully. Apr 07 06:10:56 devstack sudo[86935]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.543s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:57 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:57 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] Deleted volume successfully. Apr 07 06:10:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e6ab70a4-6f5f-452d-876a-1397d389b848 tempest-SnapshotsActionsTest-942540758 None] Lock "cinder-4b3ab98e-cf65-4e52-8e6a-1c81f4ca2f67-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] Acquiring lock "cinder-e49d171e-8c6a-4d51-8be3-2717078e3967-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] Lock "cinder-e49d171e-8c6a-4d51-8be3-2717078e3967-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] Acquiring lock "cinder-quobyte-e49d171e-8c6a-4d51-8be3-2717078e3967" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] Lock "cinder-quobyte-e49d171e-8c6a-4d51-8be3-2717078e3967" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:57 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2509fc5-0d44-4818-9858-d2bbf68f1907]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e49d171e-8c6a-4d51-8be3-2717078e3967 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:57 devstack sudo[86939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e49d171e-8c6a-4d51-8be3-2717078e3967 Apr 07 06:10:57 devstack sudo[86939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7fca54d3-09d7-4284-8592-acf851d3b6ab tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7fca54d3-09d7-4284-8592-acf851d3b6ab tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7fca54d3-09d7-4284-8592-acf851d3b6ab tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7fca54d3-09d7-4284-8592-acf851d3b6ab tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7fca54d3-09d7-4284-8592-acf851d3b6ab tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7fca54d3-09d7-4284-8592-acf851d3b6ab tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:57 devstack sudo[86941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:10:57 devstack sudo[86941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:58 devstack sudo[86939]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e49d171e-8c6a-4d51-8be3-2717078e3967" returned: 0 in 0.688s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e49d171e-8c6a-4d51-8be3-2717078e3967 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:58 devstack sudo[86946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e49d171e-8c6a-4d51-8be3-2717078e3967 Apr 07 06:10:58 devstack sudo[86946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:58 devstack sudo[86941]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7fca54d3-09d7-4284-8592-acf851d3b6ab tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.579s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:58 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-7fca54d3-09d7-4284-8592-acf851d3b6ab tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:58 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-7fca54d3-09d7-4284-8592-acf851d3b6ab tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Retype volume completed successfully. Apr 07 06:10:58 devstack sudo[86946]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e49d171e-8c6a-4d51-8be3-2717078e3967" returned: 0 in 0.558s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:58 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] Lock "cinder-quobyte-e49d171e-8c6a-4d51-8be3-2717078e3967" released by "delete_volume" :: held 1.279s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:58 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] Created reservations ['57d63bb3-6ad2-428a-8099-2ab55722d84d', 'cf7e0dab-ab79-4a1a-9f37-e20d158b30e4', '6f09dbf2-aca2-4344-8b3f-6af5d7bd7e87', 'd5912056-19e8-4f1a-8188-ae205e3481fc'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:10:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:10:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:10:58 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:10:58 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:10:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:10:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:58 devstack sudo[86950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:10:58 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:59 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Acquiring lock "cinder-8efe5709-0668-41d8-8a3a-88816ffb7ee7-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:59 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Lock "cinder-8efe5709-0668-41d8-8a3a-88816ffb7ee7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:59 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Acquiring lock "cinder-quobyte-8efe5709-0668-41d8-8a3a-88816ffb7ee7" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:10:59 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Lock "cinder-quobyte-8efe5709-0668-41d8-8a3a-88816ffb7ee7" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:10:59 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cd4d3c-d5b4-498a-af60-02dcf5ffbfc6]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:10:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8efe5709-0668-41d8-8a3a-88816ffb7ee7 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:59 devstack sudo[86952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8efe5709-0668-41d8-8a3a-88816ffb7ee7 Apr 07 06:10:59 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:10:59 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.651s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:59 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:10:59 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] Deleted volume successfully. Apr 07 06:10:59 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8ce51f25-7e0c-44c2-9db7-508e5208727e tempest-VolumeQuotasAdminTestJSON-1541238592 None] Lock "cinder-e49d171e-8c6a-4d51-8be3-2717078e3967-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:10:59 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root Apr 07 06:10:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8efe5709-0668-41d8-8a3a-88816ffb7ee7" returned: 0 in 0.750s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:10:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8efe5709-0668-41d8-8a3a-88816ffb7ee7 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:10:59 devstack sudo[86959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8efe5709-0668-41d8-8a3a-88816ffb7ee7 Apr 07 06:10:59 devstack sudo[86959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:00 devstack sudo[86959]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8efe5709-0668-41d8-8a3a-88816ffb7ee7" returned: 0 in 0.819s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:00 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Lock "cinder-quobyte-8efe5709-0668-41d8-8a3a-88816ffb7ee7" released by "delete_volume" :: held 1.602s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:00 devstack cinder-volume[82475]: WARNING cinder.quota [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:11:00 devstack cinder-volume[82475]: WARNING cinder.quota [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:11:00 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Created reservations ['7fd50471-2274-4a33-a6e3-fa4ef768cc90', '340b9ae0-ea97-4e7f-8a23-7f3bf625c1b3', 'dd2320bb-909b-4182-830b-b9e79199fdcd', '77f5db3d-a5fb-4d46-a315-4e881e6ffc55'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:00 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:00 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:00 devstack sudo[86963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:11:00 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:01 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.772s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:01 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:01 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Deleted volume successfully. Apr 07 06:11:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db1cf210-8dd7-49c8-a4ec-3b6b1947ec4c tempest-VolumeRetypeWithoutMigrationTest-1051189673 None] Lock "cinder-8efe5709-0668-41d8-8a3a-88816ffb7ee7-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Flow 'volume_create_manager' (4fe18fd5-607c-4877-94c9-74da27f76d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8bfc234-4294-43bf-b542-d0f8841f1280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8bfc234-4294-43bf-b542-d0f8841f1280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2079966844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7934781-2a21-4112-a4d2-4016f81b210e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e4bc93f0cb4460b6ae8b6050d804cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:02Z,use_quota=True,user_id='0ba14003f1c240209050afc5e032bd7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71cb6219-9980-4ebd-8d83-9f1a3e242e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71cb6219-9980-4ebd-8d83-9f1a3e242e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b43ddf-db3a-4de5-a9d6-007507a836ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b43ddf-db3a-4de5-a9d6-007507a836ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7934781-2a21-4112-a4d2-4016f81b210e', 'volume_name': 'volume-c7934781-2a21-4112-a4d2-4016f81b210e', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6810341-aa47-48e8-b2d6-f29abcb532a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6810341-aa47-48e8-b2d6-f29abcb532a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5322459e-b1db-467d-b207-0bb7a89f6413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:02 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Volume c7934781-2a21-4112-a4d2-4016f81b210e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7934781-2a21-4112-a4d2-4016f81b210e', 'volume_size': 1} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2079966844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7934781-2a21-4112-a4d2-4016f81b210e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e4bc93f0cb4460b6ae8b6050d804cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:02Z,use_quota=True,user_id='0ba14003f1c240209050afc5e032bd7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Creating volume c7934781-2a21-4112-a4d2-4016f81b210e {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:02 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:11:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c7934781-2a21-4112-a4d2-4016f81b210e 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:02 devstack sudo[86966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c7934781-2a21-4112-a4d2-4016f81b210e 1073741824 Apr 07 06:11:02 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:03 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c7934781-2a21-4112-a4d2-4016f81b210e 1073741824" returned: 0 in 0.763s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c7934781-2a21-4112-a4d2-4016f81b210e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:03 devstack sudo[86971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c7934781-2a21-4112-a4d2-4016f81b210e Apr 07 06:11:03 devstack sudo[86971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:03 devstack sudo[86971]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c7934781-2a21-4112-a4d2-4016f81b210e" returned: 0 in 0.570s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:03 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5322459e-b1db-467d-b207-0bb7a89f6413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7934781-2a21-4112-a4d2-4016f81b210e', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:03 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9a4ce6-2694-450c-a130-0a77888f383b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:03 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Volume volume-c7934781-2a21-4112-a4d2-4016f81b210e (c7934781-2a21-4112-a4d2-4016f81b210e): created successfully Apr 07 06:11:03 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9a4ce6-2694-450c-a130-0a77888f383b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:03 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Flow 'volume_create_manager' (4fe18fd5-607c-4877-94c9-74da27f76d25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:03 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-49715450-dd4c-4a3e-8012-77d3c3b097fc tempest-VolumesServicesTestJSON-1103161875 None] Created volume successfully. Apr 07 06:11:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] Acquiring lock "cinder-c7934781-2a21-4112-a4d2-4016f81b210e-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] Lock "cinder-c7934781-2a21-4112-a4d2-4016f81b210e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] Acquiring lock "cinder-quobyte-c7934781-2a21-4112-a4d2-4016f81b210e" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] Lock "cinder-quobyte-c7934781-2a21-4112-a4d2-4016f81b210e" acquired by "delete_volume" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:04 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa39c8f8-53a4-4731-a690-8f6b2a2e3406]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c7934781-2a21-4112-a4d2-4016f81b210e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:04 devstack sudo[86974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c7934781-2a21-4112-a4d2-4016f81b210e Apr 07 06:11:04 devstack sudo[86974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:05 devstack sudo[86974]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c7934781-2a21-4112-a4d2-4016f81b210e" returned: 0 in 0.639s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c7934781-2a21-4112-a4d2-4016f81b210e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:05 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c7934781-2a21-4112-a4d2-4016f81b210e Apr 07 06:11:05 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:05 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c7934781-2a21-4112-a4d2-4016f81b210e" returned: 0 in 0.512s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:05 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] Lock "cinder-quobyte-c7934781-2a21-4112-a4d2-4016f81b210e" released by "delete_volume" :: held 1.182s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:05 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] Created reservations ['f8593446-5f48-4b3c-bb6a-c5d3d979cbe2', '99af2cad-7dec-467a-bda9-2f21b621fac7', 'ea8309ca-555b-4d47-a827-9bd209e02d3c', '7d3931a0-fde5-426a-b11e-5de3df45475e'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:05 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:05 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:05 devstack sudo[86988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:11:05 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:06 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.819s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:06 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:06 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] Deleted volume successfully. Apr 07 06:11:06 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-7179683d-a56d-4160-86cb-5fc4c72ebe64 tempest-VolumesServicesTestJSON-1103161875 None] Lock "cinder-c7934781-2a21-4112-a4d2-4016f81b210e-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Flow 'volume_create_manager' (5078eead-e8ea-4a3f-a68c-392c8bef1e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7c58baf-4071-4e30-ba45-4d59ab6dd8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7c58baf-4071-4e30-ba45-4d59ab6dd8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1589414722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53dcaa00-ea79-48cd-9d23-b3f46e6a5652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f50b24f24b8845d2af1918ddf3155eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:08Z,use_quota=True,user_id='a58a160e2ff64d07b2d609cf947691b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2760d260-f721-406a-8b59-34d4ca293fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2760d260-f721-406a-8b59-34d4ca293fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3361fbae-7d7e-4622-b061-d1ef6aeea66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3361fbae-7d7e-4622-b061-d1ef6aeea66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53dcaa00-ea79-48cd-9d23-b3f46e6a5652', 'volume_name': 'volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154aaf9c-fa9a-440d-b464-e5d5b9659074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154aaf9c-fa9a-440d-b464-e5d5b9659074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6b18bf-1d48-4abe-911d-fb54be9ac8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:08 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Volume 53dcaa00-ea79-48cd-9d23-b3f46e6a5652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652', 'volume_size': 1} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1589414722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53dcaa00-ea79-48cd-9d23-b3f46e6a5652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f50b24f24b8845d2af1918ddf3155eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:08Z,use_quota=True,user_id='a58a160e2ff64d07b2d609cf947691b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Creating volume 53dcaa00-ea79-48cd-9d23-b3f46e6a5652 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:08 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:08 devstack sudo[86993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652 1073741824 Apr 07 06:11:08 devstack sudo[86993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:08 devstack sudo[86993]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652 1073741824" returned: 0 in 0.673s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:08 devstack sudo[86998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652 Apr 07 06:11:08 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:08 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Flow 'volume_create_manager' (72c3340f-1049-432d-bf20-6621aab7eb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f56d6e1-6c11-4991-83d6-de243e721583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f56d6e1-6c11-4991-83d6-de243e721583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-770414145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d9b033-1002-49f3-a520-ea3c14413452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18793983298044468e4b19c549f493b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:09Z,use_quota=True,user_id='6ed72940fe1b4c89ab0a21cda7d42f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa38b540-87e2-45e8-8d35-a044bf248c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa38b540-87e2-45e8-8d35-a044bf248c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82345827-fbbc-4040-9530-af6747192889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82345827-fbbc-4040-9530-af6747192889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70d9b033-1002-49f3-a520-ea3c14413452', 'volume_name': 'volume-70d9b033-1002-49f3-a520-ea3c14413452', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dec5cfd-fe9d-4ee3-9918-fb3c2a1c32c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dec5cfd-fe9d-4ee3-9918-fb3c2a1c32c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a1e4ca-f5b9-4e86-af73-d774e5e49524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:09 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Volume 70d9b033-1002-49f3-a520-ea3c14413452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70d9b033-1002-49f3-a520-ea3c14413452', 'volume_size': 1} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:09 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652" returned: 0 in 0.630s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.390s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-770414145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d9b033-1002-49f3-a520-ea3c14413452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18793983298044468e4b19c549f493b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:09Z,use_quota=True,user_id='6ed72940fe1b4c89ab0a21cda7d42f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Creating volume 70d9b033-1002-49f3-a520-ea3c14413452 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:09 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6b18bf-1d48-4abe-911d-fb54be9ac8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:09 devstack sudo[87001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452 1073741824 Apr 07 06:11:09 devstack sudo[87001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca3dde6-f5df-40c9-95be-211bb6f89336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:09 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Volume volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652 (53dcaa00-ea79-48cd-9d23-b3f46e6a5652): created successfully Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca3dde6-f5df-40c9-95be-211bb6f89336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Flow 'volume_create_manager' (5078eead-e8ea-4a3f-a68c-392c8bef1e79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:09 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-18771446-9b6b-4efd-a692-68f9557906f8 tempest-VolumesSnapshotTestJSON-1002577997 None] Created volume successfully. Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Flow 'volume_create_manager' (24eae603-a04b-427f-8e4a-b4858652c42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c639c2f-7f66-43e8-b549-7e9e34e214bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c639c2f-7f66-43e8-b549-7e9e34e214bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1169854887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e71900-ad63-4281-a6a1-fab6f813365d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c858ead69e1e436e9ed030502beef643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:10Z,use_quota=True,user_id='6da7d23a5f804e43b6866e6b66f267c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38f4e652-9853-4276-a753-710b338282d3),volume_type_id=38f4e652-9853-4276-a753-710b338282d3)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d974ea-dcda-478c-bf46-ee3ec74b1d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d974ea-dcda-478c-bf46-ee3ec74b1d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa53d99-85b0-4247-bb96-ad8c073fc9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa53d99-85b0-4247-bb96-ad8c073fc9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16e71900-ad63-4281-a6a1-fab6f813365d', 'volume_name': 'volume-16e71900-ad63-4281-a6a1-fab6f813365d', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65bd1fce-83d2-4952-80fb-f48744de3195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65bd1fce-83d2-4952-80fb-f48744de3195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca064008-215e-4dfd-b929-9db9f83a2617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:09 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Volume 16e71900-ad63-4281-a6a1-fab6f813365d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16e71900-ad63-4281-a6a1-fab6f813365d', 'volume_size': 1} Apr 07 06:11:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:10 devstack sudo[87001]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452 1073741824" returned: 0 in 0.646s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:10 devstack sudo[87007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452 Apr 07 06:11:10 devstack sudo[87007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1958e806-5f3c-457d-b797-186b2a87e536 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:10 devstack sudo[87007]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452" returned: 0 in 0.487s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.921s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1169854887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e71900-ad63-4281-a6a1-fab6f813365d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c858ead69e1e436e9ed030502beef643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:10Z,use_quota=True,user_id='6da7d23a5f804e43b6866e6b66f267c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38f4e652-9853-4276-a753-710b338282d3),volume_type_id=38f4e652-9853-4276-a753-710b338282d3)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Creating volume 16e71900-ad63-4281-a6a1-fab6f813365d {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:10 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-16e71900-ad63-4281-a6a1-fab6f813365d 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a1e4ca-f5b9-4e86-af73-d774e5e49524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70d9b033-1002-49f3-a520-ea3c14413452', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:10 devstack sudo[87010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-16e71900-ad63-4281-a6a1-fab6f813365d 1073741824 Apr 07 06:11:10 devstack sudo[87010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1fc198-8b55-45f1-aef1-3da2fe4b2f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:10 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Volume volume-70d9b033-1002-49f3-a520-ea3c14413452 (70d9b033-1002-49f3-a520-ea3c14413452): created successfully Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1fc198-8b55-45f1-aef1-3da2fe4b2f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Flow 'volume_create_manager' (72c3340f-1049-432d-bf20-6621aab7eb9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:10 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-9b3d8681-4a04-4359-837f-e0d20d11eebe tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Created volume successfully. Apr 07 06:11:11 devstack sudo[87010]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-09e6aa1d-b7a0-4939-bcb9-c44d8c0e731e tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-16e71900-ad63-4281-a6a1-fab6f813365d 1073741824" returned: 0 in 0.605s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-16e71900-ad63-4281-a6a1-fab6f813365d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:11 devstack sudo[87015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-16e71900-ad63-4281-a6a1-fab6f813365d Apr 07 06:11:11 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:11 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-16e71900-ad63-4281-a6a1-fab6f813365d" returned: 0 in 0.535s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:11 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1958e806-5f3c-457d-b797-186b2a87e536 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.436s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:11 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:SELECT=189,cinder:INSERT=60,cinder:UPDATE=231,cinder:DELETE=14 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:11:11 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-1958e806-5f3c-457d-b797-186b2a87e536 tempest-VolumesSnapshotTestJSON-1002577997 None] Creating offline snapshot cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9 of volume 53dcaa00-ea79-48cd-9d23-b3f46e6a5652 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:11:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca064008-215e-4dfd-b929-9db9f83a2617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16e71900-ad63-4281-a6a1-fab6f813365d', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5380efe5-05b0-46c1-83f0-7de288eddea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:11 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[48be4cb0-0292-434e-90d6-96853c795bf2]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:11 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:UPDATE=245,cinder:SELECT=205,cinder:INSERT=53,cinder:DELETE=15 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:11:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1958e806-5f3c-457d-b797-186b2a87e536 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:11 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Volume volume-16e71900-ad63-4281-a6a1-fab6f813365d (16e71900-ad63-4281-a6a1-fab6f813365d): created successfully Apr 07 06:11:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5380efe5-05b0-46c1-83f0-7de288eddea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Flow 'volume_create_manager' (24eae603-a04b-427f-8e4a-b4858652c42f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:11 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-89731600-7859-40c5-bee3-5fba8b3d2bbd tempest-VolumeTypesAccessTest-557000328 None] Created volume successfully. Apr 07 06:11:11 devstack sudo[87018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652 Apr 07 06:11:11 devstack sudo[87018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:12 devstack sudo[87018]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1958e806-5f3c-457d-b797-186b2a87e536 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652" returned: 0 in 0.615s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1958e806-5f3c-457d-b797-186b2a87e536 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:12 devstack sudo[87023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9 1G Apr 07 06:11:12 devstack sudo[87023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] Acquiring lock "cinder-16e71900-ad63-4281-a6a1-fab6f813365d-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] Lock "cinder-16e71900-ad63-4281-a6a1-fab6f813365d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] Acquiring lock "cinder-quobyte-16e71900-ad63-4281-a6a1-fab6f813365d" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] Lock "cinder-quobyte-16e71900-ad63-4281-a6a1-fab6f813365d" acquired by "delete_volume" :: waited 0.019s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:12 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc016004-a76d-4862-8a16-7fd2333122bc]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-16e71900-ad63-4281-a6a1-fab6f813365d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:13 devstack sudo[87028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-16e71900-ad63-4281-a6a1-fab6f813365d Apr 07 06:11:13 devstack sudo[87028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:13 devstack sudo[87023]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1958e806-5f3c-457d-b797-186b2a87e536 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9 1G" returned: 0 in 0.629s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1958e806-5f3c-457d-b797-186b2a87e536 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:13 devstack sudo[87030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9 Apr 07 06:11:13 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:13 devstack sudo[87028]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-16e71900-ad63-4281-a6a1-fab6f813365d" returned: 0 in 0.614s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-16e71900-ad63-4281-a6a1-fab6f813365d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:13 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:13 devstack sudo[87038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-16e71900-ad63-4281-a6a1-fab6f813365d Apr 07 06:11:13 devstack sudo[87038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1958e806-5f3c-457d-b797-186b2a87e536 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9" returned: 0 in 0.520s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:13 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-1958e806-5f3c-457d-b797-186b2a87e536 tempest-VolumesSnapshotTestJSON-1002577997 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9 is being set with open permissions: ugo+rw Apr 07 06:11:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1958e806-5f3c-457d-b797-186b2a87e536 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:13 devstack sudo[87040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9 Apr 07 06:11:13 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:14 devstack sudo[87038]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-16e71900-ad63-4281-a6a1-fab6f813365d" returned: 0 in 0.466s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] Lock "cinder-quobyte-16e71900-ad63-4281-a6a1-fab6f813365d" released by "delete_volume" :: held 1.115s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:14 devstack cinder-volume[82475]: WARNING cinder.quota [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2058410391 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2058410391, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:11:14 devstack cinder-volume[82475]: WARNING cinder.quota [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2058410391 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2058410391, it is now deprecated. Please use the default quota class for default quota. Apr 07 06:11:14 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] Created reservations ['27eb2298-2afb-47af-8c27-6c16caeeb0a5', '827cc4cd-79b6-4652-b2b9-14a9efd57799', '6752fe90-30ce-4c5e-99e4-3dcfbd9727e3', '805d8ee4-141d-4e6f-9003-621ad05b40c3'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:14 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1958e806-5f3c-457d-b797-186b2a87e536 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9" returned: 0 in 0.513s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1958e806-5f3c-457d-b797-186b2a87e536 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:14 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.info Apr 07 06:11:14 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:14 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:14 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:14 devstack sudo[87046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:11:14 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:14 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1958e806-5f3c-457d-b797-186b2a87e536 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.info" returned: 0 in 0.538s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:14 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-1958e806-5f3c-457d-b797-186b2a87e536 tempest-VolumesSnapshotTestJSON-1002577997 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.info is being set with open permissions: ugo+rw Apr 07 06:11:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1958e806-5f3c-457d-b797-186b2a87e536 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:14 devstack sudo[87050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.info Apr 07 06:11:14 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:14 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.531s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:14 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:14 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] Deleted volume successfully. Apr 07 06:11:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-9c7eae99-f9b4-48f2-845a-afe0a51bed7a tempest-VolumeTypesAccessTest-557000328 None] Lock "cinder-16e71900-ad63-4281-a6a1-fab6f813365d-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:15 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1958e806-5f3c-457d-b797-186b2a87e536 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.info" returned: 0 in 0.483s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1958e806-5f3c-457d-b797-186b2a87e536 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.392s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-09e6aa1d-b7a0-4939-bcb9-c44d8c0e731e tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.971s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-09e6aa1d-b7a0-4939-bcb9-c44d8c0e731e tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Creating offline snapshot 10e2621a-60de-4754-8785-ef6ad8e1c4d7 of volume 70d9b033-1002-49f3-a520-ea3c14413452 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:11:15 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7501a70-c66f-4b59-bfa2-bce8a50d7a09]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e6aa1d-b7a0-4939-bcb9-c44d8c0e731e tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:15 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-1958e806-5f3c-457d-b797-186b2a87e536 tempest-VolumesSnapshotTestJSON-1002577997 None] Create snapshot completed successfully Apr 07 06:11:15 devstack sudo[87053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452 Apr 07 06:11:15 devstack sudo[87053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:15 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:15 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:15 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-quobyte-53dcaa00-ea79-48cd-9d23-b3f46e6a5652" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:15 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-53dcaa00-ea79-48cd-9d23-b3f46e6a5652" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:15 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-quobyte-cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:15 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] Deleting offline snapshot cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9 of volume 53dcaa00-ea79-48cd-9d23-b3f46e6a5652 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:11:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] snapshot_file for this snap is: volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:11:15 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ca2082-bc68-4031-90f0-31ecbc91fcf8]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:15 devstack sudo[87055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9 Apr 07 06:11:15 devstack sudo[87055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:15 devstack sudo[87053]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e6aa1d-b7a0-4939-bcb9-c44d8c0e731e tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452" returned: 0 in 0.706s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e6aa1d-b7a0-4939-bcb9-c44d8c0e731e tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:16 devstack sudo[87060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7 1G Apr 07 06:11:16 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:16 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Flow 'volume_create_manager' (e5301a2f-b8f6-4cc3-ac72-e4122183a3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4229632-8afb-4287-910b-ce59ca2e4ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4229632-8afb-4287-910b-ce59ca2e4ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-134838669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e3406c-b5d4-4947-89b9-30efe6d831dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12e376eedd54e3eb24db17c050635d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:16Z,use_quota=True,user_id='33c500067a3d4e7e9b940d27f9d71314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d273c34-7313-4daf-b141-ab44c0dc8b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d273c34-7313-4daf-b141-ab44c0dc8b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7794db80-f726-4e50-88b9-0ec86fa76b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7794db80-f726-4e50-88b9-0ec86fa76b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12e3406c-b5d4-4947-89b9-30efe6d831dc', 'volume_name': 'volume-12e3406c-b5d4-4947-89b9-30efe6d831dc', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7add2d-879b-4498-af8b-da25135cb8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7add2d-879b-4498-af8b-da25135cb8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ab29b6-b141-4f77-add7-eedabc2033c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:16 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Volume 12e3406c-b5d4-4947-89b9-30efe6d831dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12e3406c-b5d4-4947-89b9-30efe6d831dc', 'volume_size': 1} Apr 07 06:11:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:16 devstack sudo[87055]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9" returned: 0 in 0.782s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:11:16 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc0a912-49f7-4843-ab8e-d8d3f82cabc7]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:16 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e6aa1d-b7a0-4939-bcb9-c44d8c0e731e tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7 1G" returned: 0 in 0.693s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e6aa1d-b7a0-4939-bcb9-c44d8c0e731e tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70d9b033-1002-49f3-a520-ea3c14413452 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:16 devstack sudo[87068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652 Apr 07 06:11:16 devstack sudo[87068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:16 devstack sudo[87069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70d9b033-1002-49f3-a520-ea3c14413452 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7 Apr 07 06:11:16 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:17 devstack sudo[87068]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652" returned: 0 in 0.671s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:17 devstack sudo[87112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9 Apr 07 06:11:17 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:17 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e6aa1d-b7a0-4939-bcb9-c44d8c0e731e tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70d9b033-1002-49f3-a520-ea3c14413452 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7" returned: 0 in 0.657s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:17 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-09e6aa1d-b7a0-4939-bcb9-c44d8c0e731e tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7 is being set with open permissions: ugo+rw Apr 07 06:11:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e6aa1d-b7a0-4939-bcb9-c44d8c0e731e tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:17 devstack sudo[87114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7 Apr 07 06:11:17 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:17 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9" returned: 0 in 0.624s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:17 devstack sudo[87120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9 Apr 07 06:11:17 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:17 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e6aa1d-b7a0-4939-bcb9-c44d8c0e731e tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7" returned: 0 in 0.669s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e6aa1d-b7a0-4939-bcb9-c44d8c0e731e tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:18 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.info Apr 07 06:11:18 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:18 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652.cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9" returned: 0 in 0.499s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:18 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9" released by "_delete_snapshot" :: held 2.672s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:18 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-53dcaa00-ea79-48cd-9d23-b3f46e6a5652" released by "delete_snapshot" :: held 2.686s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:18 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] Created reservations ['9f0d8205-1190-4a17-9824-d141beaf5f69', '7e8dfdd9-be54-4529-ae87-b0e756c303ae', '00d0ef6f-3e92-4d0e-b63e-e5c3e63dd5c7', '4d12fcf6-be1b-4844-89d4-0d4c7a59c98a'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:18 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] Delete snapshot completed successfully. Apr 07 06:11:18 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2efc93cf-c189-4f26-9b4d-d77f3678b62d tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-cb8311e3-e1cd-4ee5-b1a0-cf6be50987f9-delete_snapshot" released by "delete_snapshot" :: held 2.831s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:18 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e6aa1d-b7a0-4939-bcb9-c44d8c0e731e tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.info" returned: 0 in 0.576s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:18 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-09e6aa1d-b7a0-4939-bcb9-c44d8c0e731e tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.info is being set with open permissions: ugo+rw Apr 07 06:11:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e6aa1d-b7a0-4939-bcb9-c44d8c0e731e tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:18 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.info Apr 07 06:11:18 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:19 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e6aa1d-b7a0-4939-bcb9-c44d8c0e731e tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.info" returned: 0 in 0.584s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-09e6aa1d-b7a0-4939-bcb9-c44d8c0e731e tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.985s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.719s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-134838669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e3406c-b5d4-4947-89b9-30efe6d831dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12e376eedd54e3eb24db17c050635d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:16Z,use_quota=True,user_id='33c500067a3d4e7e9b940d27f9d71314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Creating volume 12e3406c-b5d4-4947-89b9-30efe6d831dc {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:19 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:19 devstack sudo[87129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc 1073741824 Apr 07 06:11:19 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:19 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-09e6aa1d-b7a0-4939-bcb9-c44d8c0e731e tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Create snapshot completed successfully Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Flow 'volume_create_manager' (28ebb284-08e0-496e-829d-a98632d7d14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2b4309-953d-4e69-8642-20cb806b2cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2b4309-953d-4e69-8642-20cb806b2cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-366889475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f50b24f24b8845d2af1918ddf3155eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:19Z,use_quota=True,user_id='a58a160e2ff64d07b2d609cf947691b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3093c78-8c3d-4830-b849-84aced3bcd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3093c78-8c3d-4830-b849-84aced3bcd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e36174a-b17d-4f3c-bf7d-f09c8cf4786b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e36174a-b17d-4f3c-bf7d-f09c8cf4786b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a', 'volume_name': 'volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61245b96-bae4-4bdd-94dd-f22820ab614c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61245b96-bae4-4bdd-94dd-f22820ab614c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035063e2-92bd-49bb-934d-d3020a74766e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:19 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Volume 25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a', 'volume_size': 1} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:19 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc 1073741824" returned: 0 in 0.642s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Acquiring lock "cinder-10e2621a-60de-4754-8785-ef6ad8e1c4d7-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Lock "cinder-10e2621a-60de-4754-8785-ef6ad8e1c4d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Acquiring lock "cinder-quobyte-70d9b033-1002-49f3-a520-ea3c14413452" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:19 devstack sudo[87136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc Apr 07 06:11:19 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Lock "cinder-quobyte-70d9b033-1002-49f3-a520-ea3c14413452" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Acquiring lock "cinder-quobyte-10e2621a-60de-4754-8785-ef6ad8e1c4d7" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Lock "cinder-quobyte-10e2621a-60de-4754-8785-ef6ad8e1c4d7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Deleting offline snapshot 10e2621a-60de-4754-8785-ef6ad8e1c4d7 of volume 70d9b033-1002-49f3-a520-ea3c14413452 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] snapshot_file for this snap is: volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa66bf7-43d8-4cbc-b6e8-bc75deebe7c7]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:20 devstack sudo[87138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7 Apr 07 06:11:20 devstack sudo[87138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:20 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc" returned: 0 in 0.530s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.085s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-366889475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f50b24f24b8845d2af1918ddf3155eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:19Z,use_quota=True,user_id='a58a160e2ff64d07b2d609cf947691b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Creating volume 25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:20 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ab29b6-b141-4f77-add7-eedabc2033c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12e3406c-b5d4-4947-89b9-30efe6d831dc', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a5606f-a6e2-4c8c-9c35-dd8ce6b0d8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:20 devstack sudo[87141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a 1073741824 Apr 07 06:11:20 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:20 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Volume volume-12e3406c-b5d4-4947-89b9-30efe6d831dc (12e3406c-b5d4-4947-89b9-30efe6d831dc): created successfully Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a5606f-a6e2-4c8c-9c35-dd8ce6b0d8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Flow 'volume_create_manager' (e5301a2f-b8f6-4cc3-ac72-e4122183a3c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:20 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-a115e78d-5682-44ac-84fe-fd1c03e65a1c tempest-SnapshotMetadataTestJSON-170366205 None] Created volume successfully. Apr 07 06:11:20 devstack sudo[87138]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7" returned: 0 in 0.655s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70d9b033-1002-49f3-a520-ea3c14413452(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c202d06-122c-4440-b49c-7362c21602e4]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:20 devstack sudo[87146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452 Apr 07 06:11:20 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:21 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a 1073741824" returned: 0 in 0.662s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:21 devstack sudo[87152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a Apr 07 06:11:21 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:21 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452" returned: 0 in 0.618s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:21 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7 Apr 07 06:11:21 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:21 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a" returned: 0 in 0.551s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:21 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035063e2-92bd-49bb-934d-d3020a74766e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:21 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb96480-a5f4-470a-b344-97a59205c764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:21 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Volume volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a (25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a): created successfully Apr 07 06:11:21 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb96480-a5f4-470a-b344-97a59205c764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:21 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Flow 'volume_create_manager' (28ebb284-08e0-496e-829d-a98632d7d14b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:21 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-f922a745-6274-41ed-b655-96e752a61499 tempest-VolumesSnapshotTestJSON-1002577997 None] Created volume successfully. Apr 07 06:11:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d0ee25c0-5b5d-4101-8f06-1854a8368b3c tempest-SnapshotMetadataTestJSON-170366205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d0ee25c0-5b5d-4101-8f06-1854a8368b3c tempest-SnapshotMetadataTestJSON-170366205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-d0ee25c0-5b5d-4101-8f06-1854a8368b3c tempest-SnapshotMetadataTestJSON-170366205 None] Creating offline snapshot 37339dd4-9418-40de-9089-451f3a0a8456 of volume 12e3406c-b5d4-4947-89b9-30efe6d831dc {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:11:21 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea848cb7-49e9-4969-a780-3ca71380fc36]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0ee25c0-5b5d-4101-8f06-1854a8368b3c tempest-SnapshotMetadataTestJSON-170366205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:21 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7" returned: 0 in 0.627s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:21 devstack sudo[87163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7 Apr 07 06:11:21 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:21 devstack sudo[87162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc Apr 07 06:11:21 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:22 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452.10e2621a-60de-4754-8785-ef6ad8e1c4d7" returned: 0 in 0.565s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:22 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0ee25c0-5b5d-4101-8f06-1854a8368b3c tempest-SnapshotMetadataTestJSON-170366205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc" returned: 0 in 0.614s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0ee25c0-5b5d-4101-8f06-1854a8368b3c tempest-SnapshotMetadataTestJSON-170366205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Lock "cinder-quobyte-10e2621a-60de-4754-8785-ef6ad8e1c4d7" released by "_delete_snapshot" :: held 2.545s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Lock "cinder-quobyte-70d9b033-1002-49f3-a520-ea3c14413452" released by "delete_snapshot" :: held 2.565s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:22 devstack sudo[87171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456 1G Apr 07 06:11:22 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:22 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Created reservations ['678e3c92-677f-4421-9407-599165645925', 'd9f30679-c749-4a4c-b9c0-5562da958d00', '87cfe53d-7e8b-4cbe-90ff-7f140292533c', 'fc694122-6f38-424e-99a3-e6e79b57ceb9'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7332ff95-b47b-4f31-9088-edcd261214d7 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:22 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Delete snapshot completed successfully. Apr 07 06:11:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-79cf4f02-0e32-49eb-ac70-f7274dfc9ac9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Lock "cinder-10e2621a-60de-4754-8785-ef6ad8e1c4d7-delete_snapshot" released by "delete_snapshot" :: held 2.682s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:23 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0ee25c0-5b5d-4101-8f06-1854a8368b3c tempest-SnapshotMetadataTestJSON-170366205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456 1G" returned: 0 in 0.703s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0ee25c0-5b5d-4101-8f06-1854a8368b3c tempest-SnapshotMetadataTestJSON-170366205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12e3406c-b5d4-4947-89b9-30efe6d831dc -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:23 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Acquiring lock "cinder-70d9b033-1002-49f3-a520-ea3c14413452-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:23 devstack sudo[87176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12e3406c-b5d4-4947-89b9-30efe6d831dc -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456 Apr 07 06:11:23 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:23 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Lock "cinder-70d9b033-1002-49f3-a520-ea3c14413452-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:23 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Acquiring lock "cinder-quobyte-70d9b033-1002-49f3-a520-ea3c14413452" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:23 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Lock "cinder-quobyte-70d9b033-1002-49f3-a520-ea3c14413452" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:23 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ee60c9-f848-49d6-bf25-10820c18eabf]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:23 devstack sudo[87178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452 Apr 07 06:11:23 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:23 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0ee25c0-5b5d-4101-8f06-1854a8368b3c tempest-SnapshotMetadataTestJSON-170366205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12e3406c-b5d4-4947-89b9-30efe6d831dc -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456" returned: 0 in 0.626s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:23 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-d0ee25c0-5b5d-4101-8f06-1854a8368b3c tempest-SnapshotMetadataTestJSON-170366205 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456 is being set with open permissions: ugo+rw Apr 07 06:11:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0ee25c0-5b5d-4101-8f06-1854a8368b3c tempest-SnapshotMetadataTestJSON-170366205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:23 devstack sudo[87183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456 Apr 07 06:11:23 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:23 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452" returned: 0 in 0.671s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:24 devstack sudo[87188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452 Apr 07 06:11:24 devstack sudo[87188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:24 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0ee25c0-5b5d-4101-8f06-1854a8368b3c tempest-SnapshotMetadataTestJSON-170366205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456" returned: 0 in 0.488s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0ee25c0-5b5d-4101-8f06-1854a8368b3c tempest-SnapshotMetadataTestJSON-170366205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:24 devstack sudo[87191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.info Apr 07 06:11:24 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:24 devstack sudo[87188]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d9b033-1002-49f3-a520-ea3c14413452" returned: 0 in 0.511s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:24 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Lock "cinder-quobyte-70d9b033-1002-49f3-a520-ea3c14413452" released by "delete_volume" :: held 1.233s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:24 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Created reservations ['013a1a1d-b709-4779-b243-4ee65f7d1df3', 'a774da2b-186c-4e9a-98cc-32cda7994809', 'db84842c-94aa-4b51-bb12-89baa1852b14', '30cfa99f-340b-41d4-8348-94c65fc59ecb'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:24 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:24 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:24 devstack sudo[87194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:11:24 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:24 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0ee25c0-5b5d-4101-8f06-1854a8368b3c tempest-SnapshotMetadataTestJSON-170366205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.info" returned: 0 in 0.486s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:24 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-d0ee25c0-5b5d-4101-8f06-1854a8368b3c tempest-SnapshotMetadataTestJSON-170366205 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.info is being set with open permissions: ugo+rw Apr 07 06:11:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0ee25c0-5b5d-4101-8f06-1854a8368b3c tempest-SnapshotMetadataTestJSON-170366205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:24 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.info Apr 07 06:11:24 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:25 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.506s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:25 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:25 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Deleted volume successfully. Apr 07 06:11:25 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bc3f509a-9668-41b6-8633-3e36da1ab3c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1558469197 None] Lock "cinder-70d9b033-1002-49f3-a520-ea3c14413452-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:25 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0ee25c0-5b5d-4101-8f06-1854a8368b3c tempest-SnapshotMetadataTestJSON-170366205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.info" returned: 0 in 0.501s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d0ee25c0-5b5d-4101-8f06-1854a8368b3c tempest-SnapshotMetadataTestJSON-170366205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.500s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7332ff95-b47b-4f31-9088-edcd261214d7 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.757s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:25 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d0ee25c0-5b5d-4101-8f06-1854a8368b3c tempest-SnapshotMetadataTestJSON-170366205 None] Create snapshot completed successfully Apr 07 06:11:25 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-7332ff95-b47b-4f31-9088-edcd261214d7 tempest-VolumesSnapshotTestJSON-1002577997 None] Creating offline snapshot b7508659-2525-46e5-a399-45614057f8c1 of volume 25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:11:25 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf7fd03-89ef-4886-a4b8-b116198fc9f2]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7332ff95-b47b-4f31-9088-edcd261214d7 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:25 devstack sudo[87201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a Apr 07 06:11:25 devstack sudo[87201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:26 devstack sudo[87201]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7332ff95-b47b-4f31-9088-edcd261214d7 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a" returned: 0 in 0.708s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7332ff95-b47b-4f31-9088-edcd261214d7 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:26 devstack sudo[87206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1 1G Apr 07 06:11:26 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] Acquiring lock "cinder-37339dd4-9418-40de-9089-451f3a0a8456-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] Lock "cinder-37339dd4-9418-40de-9089-451f3a0a8456-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] Acquiring lock "cinder-quobyte-12e3406c-b5d4-4947-89b9-30efe6d831dc" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] Lock "cinder-quobyte-12e3406c-b5d4-4947-89b9-30efe6d831dc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] Acquiring lock "cinder-quobyte-37339dd4-9418-40de-9089-451f3a0a8456" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] Lock "cinder-quobyte-37339dd4-9418-40de-9089-451f3a0a8456" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] Deleting offline snapshot 37339dd4-9418-40de-9089-451f3a0a8456 of volume 12e3406c-b5d4-4947-89b9-30efe6d831dc {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:11:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] snapshot_file for this snap is: volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:11:26 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0bdd94-65b3-407f-a179-88cc9ce10f20]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:26 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7332ff95-b47b-4f31-9088-edcd261214d7 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1 1G" returned: 0 in 0.781s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7332ff95-b47b-4f31-9088-edcd261214d7 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:26 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1 Apr 07 06:11:26 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:26 devstack sudo[87211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456 Apr 07 06:11:26 devstack sudo[87211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:27 devstack sudo[87211]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456" returned: 0 in 0.678s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:27 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12e3406c-b5d4-4947-89b9-30efe6d831dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:11:27 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc712d9-7850-44a2-8124-0f545216c573]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:27 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7332ff95-b47b-4f31-9088-edcd261214d7 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1" returned: 0 in 0.737s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:27 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-7332ff95-b47b-4f31-9088-edcd261214d7 tempest-VolumesSnapshotTestJSON-1002577997 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1 is being set with open permissions: ugo+rw Apr 07 06:11:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7332ff95-b47b-4f31-9088-edcd261214d7 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:27 devstack sudo[87221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc Apr 07 06:11:27 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:27 devstack sudo[87222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1 Apr 07 06:11:27 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:28 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc" returned: 0 in 0.740s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:28 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7332ff95-b47b-4f31-9088-edcd261214d7 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1" returned: 0 in 0.647s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:28 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456 Apr 07 06:11:28 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7332ff95-b47b-4f31-9088-edcd261214d7 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:28 devstack sudo[87231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.info Apr 07 06:11:28 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:28 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7332ff95-b47b-4f31-9088-edcd261214d7 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.info" returned: 0 in 0.589s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:28 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-7332ff95-b47b-4f31-9088-edcd261214d7 tempest-VolumesSnapshotTestJSON-1002577997 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.info is being set with open permissions: ugo+rw Apr 07 06:11:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7332ff95-b47b-4f31-9088-edcd261214d7 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:28 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456" returned: 0 in 0.683s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:28 devstack sudo[87237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.info Apr 07 06:11:28 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:28 devstack sudo[87238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456 Apr 07 06:11:28 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:29 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc.37339dd4-9418-40de-9089-451f3a0a8456" returned: 0 in 0.557s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:29 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:29 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] Lock "cinder-quobyte-37339dd4-9418-40de-9089-451f3a0a8456" released by "_delete_snapshot" :: held 2.740s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7332ff95-b47b-4f31-9088-edcd261214d7 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.info" returned: 0 in 0.630s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7332ff95-b47b-4f31-9088-edcd261214d7 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.207s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:29 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] Lock "cinder-quobyte-12e3406c-b5d4-4947-89b9-30efe6d831dc" released by "delete_snapshot" :: held 2.775s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:29 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-7332ff95-b47b-4f31-9088-edcd261214d7 tempest-VolumesSnapshotTestJSON-1002577997 None] Create snapshot completed successfully Apr 07 06:11:29 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] Created reservations ['33d1ac16-04a7-4702-a4d7-f29e7db64688', 'aa194c41-55d0-4c8a-90f5-cc1fbd9f1593', 'bb43b5cc-3c7c-46f0-9ccc-0e9798d8cfec', 'b8f5889f-aa2e-472f-a143-dd21d1a86e39'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:29 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] Delete snapshot completed successfully. Apr 07 06:11:29 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8fdc31af-ab33-4b43-8a66-e4d5c5e3165c tempest-SnapshotMetadataTestJSON-170366205 None] Lock "cinder-37339dd4-9418-40de-9089-451f3a0a8456-delete_snapshot" released by "delete_snapshot" :: held 2.924s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Flow 'volume_create_manager' (8a3c416b-7d04-442d-9a18-8039abd7c76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61940dd0-fff7-40a0-986b-9f53f3961734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61940dd0-fff7-40a0-986b-9f53f3961734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-76802591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fbd1ceb3ef49a5b7b1272d9d0d18a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:30Z,use_quota=True,user_id='45cdb4791e764a8db8f72500106dc747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b6dea5-8e4d-491e-abfc-1e3219942c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b6dea5-8e4d-491e-abfc-1e3219942c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a63830-67a5-4914-b642-3675a9317a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a63830-67a5-4914-b642-3675a9317a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a', 'volume_name': 'volume-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7f52ce-ff54-496c-94f5-efcec597e7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7f52ce-ff54-496c-94f5-efcec597e7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed26b76f-aef7-49a1-95ea-ed975687bd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:30 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Volume b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a', 'volume_size': 1} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-76802591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fbd1ceb3ef49a5b7b1272d9d0d18a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:30Z,use_quota=True,user_id='45cdb4791e764a8db8f72500106dc747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Creating volume b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:30 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] Acquiring lock "cinder-12e3406c-b5d4-4947-89b9-30efe6d831dc-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:30 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a 1073741824 Apr 07 06:11:30 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] Lock "cinder-12e3406c-b5d4-4947-89b9-30efe6d831dc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] Acquiring lock "cinder-quobyte-12e3406c-b5d4-4947-89b9-30efe6d831dc" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] Lock "cinder-quobyte-12e3406c-b5d4-4947-89b9-30efe6d831dc" acquired by "delete_volume" :: waited 0.015s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b92d48-9280-4202-9f53-722514919393]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Flow 'volume_create_manager' (83afdb7c-ce1c-4636-94c6-a746ca34b566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2615eaee-5495-467f-952e-cb9eb91d3b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2615eaee-5495-467f-952e-cb9eb91d3b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1430967908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85cee894-45c0-46cc-8a53-73e1eee59bb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f50b24f24b8845d2af1918ddf3155eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b7508659-2525-46e5-a399-45614057f8c1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:30Z,use_quota=True,user_id='a58a160e2ff64d07b2d609cf947691b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f94dc6-761d-4375-a67b-30f8a8b8c675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f94dc6-761d-4375-a67b-30f8a8b8c675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:30 devstack sudo[87246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc Apr 07 06:11:30 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d9ea78-f358-4c85-bc83-a4b1e9ecb2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d9ea78-f358-4c85-bc83-a4b1e9ecb2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '85cee894-45c0-46cc-8a53-73e1eee59bb3', 'volume_name': 'volume-85cee894-45c0-46cc-8a53-73e1eee59bb3', 'volume_size': 2, 'snapshot_id': 'b7508659-2525-46e5-a399-45614057f8c1'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e07d4f9-750e-4154-bdef-bb46c7f4da25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e07d4f9-750e-4154-bdef-bb46c7f4da25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5acc71dc-f5a9-4f73-9a1c-50b04b168c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:30 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Volume 85cee894-45c0-46cc-8a53-73e1eee59bb3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-85cee894-45c0-46cc-8a53-73e1eee59bb3', 'volume_size': 2, 'snapshot_id': 'b7508659-2525-46e5-a399-45614057f8c1'} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:30 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a 1073741824" returned: 0 in 0.598s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:30 devstack sudo[87254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a Apr 07 06:11:30 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:30 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc" returned: 0 in 0.586s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:30 devstack sudo[87256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc Apr 07 06:11:30 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:31 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a" returned: 0 in 0.545s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.945s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-quobyte-b7508659-2525-46e5-a399-45614057f8c1-85cee894-45c0-46cc-8a53-73e1eee59bb3" by "_create_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed26b76f-aef7-49a1-95ea-ed975687bd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21176254-2905-4363-9428-71acff5f6a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:31 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-12e3406c-b5d4-4947-89b9-30efe6d831dc" returned: 0 in 0.506s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-b7508659-2525-46e5-a399-45614057f8c1-85cee894-45c0-46cc-8a53-73e1eee59bb3" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Creating volume 85cee894-45c0-46cc-8a53-73e1eee59bb3 from snapshot b7508659-2525-46e5-a399-45614057f8c1 {{(pid=82475) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-quobyte-85cee894-45c0-46cc-8a53-73e1eee59bb3" by "_copy_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:31 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Volume volume-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a (b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a): created successfully Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21176254-2905-4363-9428-71acff5f6a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Flow 'volume_create_manager' (8a3c416b-7d04-442d-9a18-8039abd7c76a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] Lock "cinder-quobyte-12e3406c-b5d4-4947-89b9-30efe6d831dc" released by "delete_volume" :: held 1.164s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:31 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-1e0b7f5d-c380-47f6-a84d-f5e0f2c95b99 tempest-VolumesListAdminTestJSON-5094963 None] Created volume successfully. Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-85cee894-45c0-46cc-8a53-73e1eee59bb3" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] snapshot: b7508659-2525-46e5-a399-45614057f8c1, volume: 85cee894-45c0-46cc-8a53-73e1eee59bb3, {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cc6687-1e15-45da-889c-b81d632980c2]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] Created reservations ['89ff2374-e979-496a-9d77-d20f76111d0d', '8e3537df-8b67-4694-89e2-0db8cee04215', '6fefe49e-f02f-424f-a541-76535163e638', '882ea5ca-86b3-4be6-aa0f-02e603805f04'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:31 devstack sudo[87260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1 Apr 07 06:11:31 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:31 devstack sudo[87262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:11:31 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:31 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.459s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:32 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] Deleted volume successfully. Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-04b5802f-d81c-47c7-bffb-e4a9fe993ada tempest-SnapshotMetadataTestJSON-170366205 None] Lock "cinder-12e3406c-b5d4-4947-89b9-30efe6d831dc-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:32 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1" returned: 0 in 0.573s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] will copy from snapshot at /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Creating direct copy from snapshot {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[6496b494-c9e2-411c-86c2-72f25a2225bf]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:32 devstack sudo[87268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a Apr 07 06:11:32 devstack sudo[87268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Flow 'volume_create_manager' (99eeae21-6940-4a15-b479-ab38f8aac1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af7e7370-2b22-4e3b-be34-45e6bcadd13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af7e7370-2b22-4e3b-be34-45e6bcadd13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1823122716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde2bebd-1a49-4527-b23e-85f2f15b1059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fbd1ceb3ef49a5b7b1272d9d0d18a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:33Z,use_quota=True,user_id='45cdb4791e764a8db8f72500106dc747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1efcc65b-6d53-45b8-953a-b10e756181c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1efcc65b-6d53-45b8-953a-b10e756181c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c5f70a-5071-4516-b5d1-8c5505ce88de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c5f70a-5071-4516-b5d1-8c5505ce88de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde2bebd-1a49-4527-b23e-85f2f15b1059', 'volume_name': 'volume-bde2bebd-1a49-4527-b23e-85f2f15b1059', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d098b5-05f8-4d9c-943d-c6c763fc29fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d098b5-05f8-4d9c-943d-c6c763fc29fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618a7a4e-98e1-4a3f-8c39-d2cb1376c019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:32 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Volume bde2bebd-1a49-4527-b23e-85f2f15b1059: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde2bebd-1a49-4527-b23e-85f2f15b1059', 'volume_size': 1} Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:32 devstack sudo[87268]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a" returned: 0 in 0.796s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG cinder.utils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Path /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85cee894-45c0-46cc-8a53-73e1eee59bb3 not found in is_blk_device check {{(pid=82475) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:11:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85cee894-45c0-46cc-8a53-73e1eee59bb3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:32 devstack sudo[87273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85cee894-45c0-46cc-8a53-73e1eee59bb3 Apr 07 06:11:32 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:35 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85cee894-45c0-46cc-8a53-73e1eee59bb3" returned: 0 in 2.661s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:35 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c3b6d5-41b6-441f-82c5-6d86c4f0e19c]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:35 devstack sudo[87285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a Apr 07 06:11:35 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:36 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a" returned: 0 in 0.748s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Image conversion details: src /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a, size 1024.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85cee894-45c0-46cc-8a53-73e1eee59bb3 {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:11:36 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Converted 1024.00 MB image at 384.45 MB/s Apr 07 06:11:36 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85cee894-45c0-46cc-8a53-73e1eee59bb3 is being set with open permissions: ugo+rw Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85cee894-45c0-46cc-8a53-73e1eee59bb3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:36 devstack sudo[87290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85cee894-45c0-46cc-8a53-73e1eee59bb3 Apr 07 06:11:36 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:36 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85cee894-45c0-46cc-8a53-73e1eee59bb3" returned: 0 in 0.607s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-85cee894-45c0-46cc-8a53-73e1eee59bb3" released by "_copy_volume_from_snapshot" :: held 5.461s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-b7508659-2525-46e5-a399-45614057f8c1-85cee894-45c0-46cc-8a53-73e1eee59bb3" released by "_create_volume_from_snapshot" :: held 5.510s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.551s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.158s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1823122716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde2bebd-1a49-4527-b23e-85f2f15b1059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fbd1ceb3ef49a5b7b1272d9d0d18a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:33Z,use_quota=True,user_id='45cdb4791e764a8db8f72500106dc747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Creating volume bde2bebd-1a49-4527-b23e-85f2f15b1059 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:36 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bde2bebd-1a49-4527-b23e-85f2f15b1059 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5acc71dc-f5a9-4f73-9a1c-50b04b168c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85cee894-45c0-46cc-8a53-73e1eee59bb3', 'volume_size': 2, 'snapshot_id': 'b7508659-2525-46e5-a399-45614057f8c1'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:36 devstack sudo[87293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bde2bebd-1a49-4527-b23e-85f2f15b1059 1073741824 Apr 07 06:11:36 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff785b10-94fc-4140-8662-ddb710794469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:36 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Volume volume-85cee894-45c0-46cc-8a53-73e1eee59bb3 (85cee894-45c0-46cc-8a53-73e1eee59bb3): created successfully Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff785b10-94fc-4140-8662-ddb710794469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:36 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Flow 'volume_create_manager' (83afdb7c-ce1c-4636-94c6-a746ca34b566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:36 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-578f22d8-9f04-46e7-aced-93e5440d5ae6 tempest-VolumesSnapshotTestJSON-1002577997 None] Created volume successfully. Apr 07 06:11:37 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bde2bebd-1a49-4527-b23e-85f2f15b1059 1073741824" returned: 0 in 0.647s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bde2bebd-1a49-4527-b23e-85f2f15b1059 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:37 devstack sudo[87298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bde2bebd-1a49-4527-b23e-85f2f15b1059 Apr 07 06:11:37 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-85cee894-45c0-46cc-8a53-73e1eee59bb3-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-85cee894-45c0-46cc-8a53-73e1eee59bb3-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Flow 'volume_create_manager' (52f15d64-727e-4e63-9858-8e3d944a5088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:38 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12a672e-a715-470c-add7-9ff92cea00bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bde2bebd-1a49-4527-b23e-85f2f15b1059" returned: 0 in 0.566s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12a672e-a715-470c-add7-9ff92cea00bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2040432890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5564d5-1da3-4e39-8a45-508e66bdc76d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38655c7bf1f4ca8864aafa59acf37ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:38Z,use_quota=True,user_id='6406fbf14a65462ba1e9f5e81f566149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f35d77-15a8-4dd0-9c30-6799625a9c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f35d77-15a8-4dd0-9c30-6799625a9c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee1ffb3-96cb-41e1-844c-20cda8f0a61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee1ffb3-96cb-41e1-844c-20cda8f0a61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5564d5-1da3-4e39-8a45-508e66bdc76d', 'volume_name': 'volume-ef5564d5-1da3-4e39-8a45-508e66bdc76d', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7464e3-93f6-4928-8ad9-1d645cdd1f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7464e3-93f6-4928-8ad9-1d645cdd1f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9e034a-6489-4015-a7f9-5354733962c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:38 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Volume ef5564d5-1da3-4e39-8a45-508e66bdc76d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5564d5-1da3-4e39-8a45-508e66bdc76d', 'volume_size': 1} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2040432890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5564d5-1da3-4e39-8a45-508e66bdc76d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38655c7bf1f4ca8864aafa59acf37ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:38Z,use_quota=True,user_id='6406fbf14a65462ba1e9f5e81f566149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Creating volume ef5564d5-1da3-4e39-8a45-508e66bdc76d {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:38 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ef5564d5-1da3-4e39-8a45-508e66bdc76d 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618a7a4e-98e1-4a3f-8c39-d2cb1376c019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde2bebd-1a49-4527-b23e-85f2f15b1059', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:38 devstack sudo[87301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ef5564d5-1da3-4e39-8a45-508e66bdc76d 1073741824 Apr 07 06:11:38 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4384572-cac2-4571-a377-79423c93d716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-quobyte-85cee894-45c0-46cc-8a53-73e1eee59bb3" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:38 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Volume volume-bde2bebd-1a49-4527-b23e-85f2f15b1059 (bde2bebd-1a49-4527-b23e-85f2f15b1059): created successfully Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4384572-cac2-4571-a377-79423c93d716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Flow 'volume_create_manager' (99eeae21-6940-4a15-b479-ab38f8aac1c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-85cee894-45c0-46cc-8a53-73e1eee59bb3" acquired by "delete_volume" :: waited 0.019s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:38 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-3e0ee1a0-7713-4d3f-b6ba-00d588e17690 tempest-VolumesListAdminTestJSON-5094963 None] Created volume successfully. Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1df2ec7-c359-4dc0-8c13-04b20773e973]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85cee894-45c0-46cc-8a53-73e1eee59bb3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:38 devstack sudo[87303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85cee894-45c0-46cc-8a53-73e1eee59bb3 Apr 07 06:11:38 devstack sudo[87303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:38 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ef5564d5-1da3-4e39-8a45-508e66bdc76d 1073741824" returned: 0 in 0.579s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ef5564d5-1da3-4e39-8a45-508e66bdc76d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:38 devstack sudo[87311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ef5564d5-1da3-4e39-8a45-508e66bdc76d Apr 07 06:11:38 devstack sudo[87311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:38 devstack sudo[87303]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85cee894-45c0-46cc-8a53-73e1eee59bb3" returned: 0 in 0.583s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85cee894-45c0-46cc-8a53-73e1eee59bb3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:38 devstack sudo[87313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85cee894-45c0-46cc-8a53-73e1eee59bb3 Apr 07 06:11:38 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:39 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85cee894-45c0-46cc-8a53-73e1eee59bb3" returned: 0 in 0.572s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-85cee894-45c0-46cc-8a53-73e1eee59bb3" released by "delete_volume" :: held 1.199s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:39 devstack sudo[87311]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ef5564d5-1da3-4e39-8a45-508e66bdc76d" returned: 0 in 0.713s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9e034a-6489-4015-a7f9-5354733962c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5564d5-1da3-4e39-8a45-508e66bdc76d', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1519d35c-a440-4a83-97bf-55357ccc5f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] Created reservations ['e6ff79ef-6251-4f63-816b-eb0337771966', 'bfae45c1-0e7e-407e-9d19-4122edba4942', '8aeed3c2-60c5-4212-8894-963e166e13a7', '9285d6d8-fe3a-42c8-9033-35f20fe717be'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:39 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Volume volume-ef5564d5-1da3-4e39-8a45-508e66bdc76d (ef5564d5-1da3-4e39-8a45-508e66bdc76d): created successfully Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1519d35c-a440-4a83-97bf-55357ccc5f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Flow 'volume_create_manager' (52f15d64-727e-4e63-9858-8e3d944a5088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:39 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-1cd49efe-953f-4326-9f7e-33f574f4d7a2 tempest-VolumesNegativeTest-1194753037 None] Created volume successfully. Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:39 devstack sudo[87318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:11:39 devstack sudo[87318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Flow 'volume_create_manager' (697fc6b8-c87b-4c23-be24-ed9d76cd0ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63607c9-9e08-438d-9b83-1fe96e1854f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63607c9-9e08-438d-9b83-1fe96e1854f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-556844005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d59db10-28c1-4339-8d33-be7e534e5536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fbd1ceb3ef49a5b7b1272d9d0d18a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:40Z,use_quota=True,user_id='45cdb4791e764a8db8f72500106dc747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b8bb88-12df-466e-8a87-1a985abdbeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b8bb88-12df-466e-8a87-1a985abdbeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12544c54-4d7a-4f41-9bd8-442780a32c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12544c54-4d7a-4f41-9bd8-442780a32c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d59db10-28c1-4339-8d33-be7e534e5536', 'volume_name': 'volume-1d59db10-28c1-4339-8d33-be7e534e5536', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4879699c-1799-4bd9-9a0b-b46efd88eb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4879699c-1799-4bd9-9a0b-b46efd88eb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9fcc4b-a14f-4e81-a9d7-05c72e28608e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:39 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Volume 1d59db10-28c1-4339-8d33-be7e534e5536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d59db10-28c1-4339-8d33-be7e534e5536', 'volume_size': 1} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-556844005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d59db10-28c1-4339-8d33-be7e534e5536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fbd1ceb3ef49a5b7b1272d9d0d18a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:40Z,use_quota=True,user_id='45cdb4791e764a8db8f72500106dc747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Creating volume 1d59db10-28c1-4339-8d33-be7e534e5536 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:39 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:11:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1d59db10-28c1-4339-8d33-be7e534e5536 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:39 devstack sudo[87320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1d59db10-28c1-4339-8d33-be7e534e5536 1073741824 Apr 07 06:11:39 devstack sudo[87320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:40 devstack sudo[87318]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.533s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:40 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:40 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] Deleted volume successfully. Apr 07 06:11:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-cf744d8f-0342-42fa-9f3b-f3282c2a3027 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-85cee894-45c0-46cc-8a53-73e1eee59bb3-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-b7508659-2525-46e5-a399-45614057f8c1-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-b7508659-2525-46e5-a399-45614057f8c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-quobyte-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-quobyte-b7508659-2525-46e5-a399-45614057f8c1" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-b7508659-2525-46e5-a399-45614057f8c1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] Deleting offline snapshot b7508659-2525-46e5-a399-45614057f8c1 of volume 25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:11:40 devstack sudo[87320]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] snapshot_file for this snap is: volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:11:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1d59db10-28c1-4339-8d33-be7e534e5536 1073741824" returned: 0 in 0.618s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:40 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f89a58-8d88-4e45-a2c1-9acc3c614173]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1d59db10-28c1-4339-8d33-be7e534e5536 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:40 devstack sudo[87327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1d59db10-28c1-4339-8d33-be7e534e5536 Apr 07 06:11:40 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:40 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1 Apr 07 06:11:40 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:41 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1d59db10-28c1-4339-8d33-be7e534e5536" returned: 0 in 0.627s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:41 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9fcc4b-a14f-4e81-a9d7-05c72e28608e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d59db10-28c1-4339-8d33-be7e534e5536', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce86cf7-7259-4ad1-8d14-f687867bf60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1" returned: 0 in 0.691s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:11:41 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98305fd-408f-43dc-af66-34a7996fbaf5]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:41 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Volume volume-1d59db10-28c1-4339-8d33-be7e534e5536 (1d59db10-28c1-4339-8d33-be7e534e5536): created successfully Apr 07 06:11:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce86cf7-7259-4ad1-8d14-f687867bf60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Flow 'volume_create_manager' (697fc6b8-c87b-4c23-be24-ed9d76cd0ba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:41 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-0ef613a4-f882-43d4-8424-c88f7b0a76d6 tempest-VolumesListAdminTestJSON-5094963 None] Created volume successfully. Apr 07 06:11:41 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a Apr 07 06:11:41 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:41 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a" returned: 0 in 0.795s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:41 devstack sudo[87343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1 Apr 07 06:11:41 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Flow 'volume_create_manager' (73f1ea45-66c4-4031-9dda-f06ef56f7a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb5fec0-f1dd-46ea-95cb-7078129d5e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb5fec0-f1dd-46ea-95cb-7078129d5e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa5ccaf-c2e6-4d54-875c-3c1050c7b832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7383331735994ac1a2c5eb90fa34e029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:42Z,use_quota=True,user_id='4127fe25341b466d98c49dcb6482f01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c400ce41-c7c3-4048-b133-0f2e033cbb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c400ce41-c7c3-4048-b133-0f2e033cbb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25bdd99d-8626-48d6-b8d8-093ee8c98e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25bdd99d-8626-48d6-b8d8-093ee8c98e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfa5ccaf-c2e6-4d54-875c-3c1050c7b832', 'volume_name': 'volume-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7fe8520-5a4f-421a-a2ef-8d57eae856d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7fe8520-5a4f-421a-a2ef-8d57eae856d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4d1bec-2bbe-4a15-b470-94d6eb03e916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:42 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Volume cfa5ccaf-c2e6-4d54-875c-3c1050c7b832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832', 'volume_size': 1} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa5ccaf-c2e6-4d54-875c-3c1050c7b832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7383331735994ac1a2c5eb90fa34e029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:42Z,use_quota=True,user_id='4127fe25341b466d98c49dcb6482f01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Creating volume cfa5ccaf-c2e6-4d54-875c-3c1050c7b832 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:42 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:42 devstack sudo[87348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832 1073741824 Apr 07 06:11:42 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:42 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1" returned: 0 in 0.677s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:42 devstack sudo[87350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1 Apr 07 06:11:42 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:43 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832 1073741824" returned: 0 in 0.656s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:43 devstack sudo[87356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832 Apr 07 06:11:43 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:43 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a.b7508659-2525-46e5-a399-45614057f8c1" returned: 0 in 0.593s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-b7508659-2525-46e5-a399-45614057f8c1" released by "_delete_snapshot" :: held 2.844s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a" released by "delete_snapshot" :: held 2.867s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] Created reservations ['88d4eeeb-ee29-4317-9759-59c599e139fb', 'daad89d0-f8b8-417b-ab92-e46b5429eaec', '24601ef7-eb69-4b86-b247-bc0eca845da3', 'f0475ece-d24b-4198-b12a-fd9c59962100'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:43 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] Delete snapshot completed successfully. Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d7d8dad4-06b0-4798-9cb6-85c340a2c8e2 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-b7508659-2525-46e5-a399-45614057f8c1-delete_snapshot" released by "delete_snapshot" :: held 3.013s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-quobyte-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:43 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832" returned: 0 in 0.589s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d55d78-e1d9-4cde-aa06-a4f4c8110bb8]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4d1bec-2bbe-4a15-b470-94d6eb03e916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f278b4-20db-42c2-8b1d-ef7740075a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:43 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Volume volume-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832 (cfa5ccaf-c2e6-4d54-875c-3c1050c7b832): created successfully Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f278b4-20db-42c2-8b1d-ef7740075a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:43 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Flow 'volume_create_manager' (73f1ea45-66c4-4031-9dda-f06ef56f7a82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:43 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d8c82ea8-a408-4677-a81f-0ce3d3738943 tempest-VolumesListAdminTestJSON-1912153749 None] Created volume successfully. Apr 07 06:11:43 devstack sudo[87359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a Apr 07 06:11:43 devstack sudo[87359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:44 devstack sudo[87359]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a" returned: 0 in 0.594s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:44 devstack sudo[87364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a Apr 07 06:11:44 devstack sudo[87364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:44 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] Acquiring lock "cinder-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:44 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] Lock "cinder-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:44 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] Acquiring lock "cinder-quobyte-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:44 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] Lock "cinder-quobyte-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:44 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[37632ca3-7422-486f-82b6-06049054430a]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:44 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] Acquiring lock "cinder-1d59db10-28c1-4339-8d33-be7e534e5536-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:44 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] Lock "cinder-1d59db10-28c1-4339-8d33-be7e534e5536-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:44 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] Acquiring lock "cinder-quobyte-1d59db10-28c1-4339-8d33-be7e534e5536" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:44 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] Lock "cinder-quobyte-1d59db10-28c1-4339-8d33-be7e534e5536" acquired by "delete_volume" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:44 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaeb2897-b58e-4e3b-a9b0-e076a26f186e]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1d59db10-28c1-4339-8d33-be7e534e5536 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:44 devstack sudo[87366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832 Apr 07 06:11:44 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:44 devstack sudo[87368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1d59db10-28c1-4339-8d33-be7e534e5536 Apr 07 06:11:44 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:45 devstack sudo[87364]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a" returned: 0 in 0.804s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:45 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a" released by "delete_volume" :: held 1.450s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:45 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] Created reservations ['495a80d5-d4cc-4f47-8fea-70c6602cfe55', '816fc88b-ef8d-4a00-96e7-d14ecf7d75aa', 'e4a9d91a-88d1-464f-9a85-63863815c308', '8b14a301-10ac-45b3-90f1-1d0a9c8c81f2'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:45 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:45 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:45 devstack sudo[87371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:11:45 devstack sudo[87371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:45 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832" returned: 0 in 0.823s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:45 devstack sudo[87379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832 Apr 07 06:11:45 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:45 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1d59db10-28c1-4339-8d33-be7e534e5536" returned: 0 in 0.822s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1d59db10-28c1-4339-8d33-be7e534e5536 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:45 devstack sudo[87381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1d59db10-28c1-4339-8d33-be7e534e5536 Apr 07 06:11:45 devstack sudo[87381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:46 devstack sudo[87371]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.784s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:46 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] Deleted volume successfully. Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0ca16cd1-2c51-43dd-b1e3-13384ee8bc98 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-25f0a5e9-4b6e-47dd-94fb-3302ee5a6a9a-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Flow 'volume_create_manager' (db1581ac-d7d2-40f4-afc3-7ece9802330a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb3f14d-ece2-441c-9b65-212e22624a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:46 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb3f14d-ece2-441c-9b65-212e22624a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1583171476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a458de-e456-40ee-9d6c-05614d89d56c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f50b24f24b8845d2af1918ddf3155eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:46Z,use_quota=True,user_id='a58a160e2ff64d07b2d609cf947691b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (555a21d4-7216-4c97-880b-bf423dea7292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (555a21d4-7216-4c97-880b-bf423dea7292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b862d67-a5ff-4194-811c-5dc7b4d0e1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b862d67-a5ff-4194-811c-5dc7b4d0e1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65a458de-e456-40ee-9d6c-05614d89d56c', 'volume_name': 'volume-65a458de-e456-40ee-9d6c-05614d89d56c', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc938ac-b1ef-4be0-a631-781cabcce2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc938ac-b1ef-4be0-a631-781cabcce2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d84fef4c-d93f-4fe3-bbe4-1b36802ea166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:46 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Volume 65a458de-e456-40ee-9d6c-05614d89d56c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65a458de-e456-40ee-9d6c-05614d89d56c', 'volume_size': 1} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1583171476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a458de-e456-40ee-9d6c-05614d89d56c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f50b24f24b8845d2af1918ddf3155eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:46Z,use_quota=True,user_id='a58a160e2ff64d07b2d609cf947691b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Creating volume 65a458de-e456-40ee-9d6c-05614d89d56c {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:46 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832" returned: 0 in 1.079s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] Lock "cinder-quobyte-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832" released by "delete_volume" :: held 1.937s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:46 devstack sudo[87386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c 1073741824 Apr 07 06:11:46 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] Created reservations ['35eed2d4-55fb-4c39-896e-52082a5c8410', '57303459-fcbf-4bc4-8e95-0db960de21bb', 'b91342bd-5a0b-4f46-a5ac-2e3354a8e92b', 'd660ec89-7217-47d9-b02b-e3f6fd7af3b6'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:46 devstack sudo[87381]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1d59db10-28c1-4339-8d33-be7e534e5536" returned: 0 in 1.045s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] Lock "cinder-quobyte-1d59db10-28c1-4339-8d33-be7e534e5536" released by "delete_volume" :: held 1.913s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] Created reservations ['43a204bc-98b3-4363-9585-d08fe2b5824f', 'f671346e-edac-4511-93ee-a3444877a29b', '9aadedc3-c045-4a70-b702-5d9bc23fa36b', '56378b85-9e6c-4854-bd46-50e75374b21a'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:46 devstack sudo[87388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:11:46 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:47 devstack sudo[87390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:11:47 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] Acquiring lock "cinder-bde2bebd-1a49-4527-b23e-85f2f15b1059-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] Lock "cinder-bde2bebd-1a49-4527-b23e-85f2f15b1059-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] Acquiring lock "cinder-quobyte-bde2bebd-1a49-4527-b23e-85f2f15b1059" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] Lock "cinder-quobyte-bde2bebd-1a49-4527-b23e-85f2f15b1059" acquired by "delete_volume" :: waited 0.037s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:47 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ab63b3-603e-4f7a-9b13-f68143870688]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bde2bebd-1a49-4527-b23e-85f2f15b1059 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:47 devstack sudo[87392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bde2bebd-1a49-4527-b23e-85f2f15b1059 Apr 07 06:11:47 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:47 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c 1073741824" returned: 0 in 1.172s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:47 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.900s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:47 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:47 devstack sudo[87403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c Apr 07 06:11:47 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:47 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] Deleted volume successfully. Apr 07 06:11:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b0ab6ad4-5f45-4fc8-97bb-8f3bd77a8c85 tempest-VolumesListAdminTestJSON-5094963 None] Lock "cinder-1d59db10-28c1-4339-8d33-be7e534e5536-delete_volume" released by "delete_volume" :: held 3.126s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:48 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 1.247s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:48 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:48 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] Deleted volume successfully. Apr 07 06:11:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f993a830-b37f-4639-b263-bf23f970f193 tempest-VolumesListAdminTestJSON-1912153749 None] Lock "cinder-cfa5ccaf-c2e6-4d54-875c-3c1050c7b832-delete_volume" released by "delete_volume" :: held 3.447s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:48 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bde2bebd-1a49-4527-b23e-85f2f15b1059" returned: 0 in 0.927s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bde2bebd-1a49-4527-b23e-85f2f15b1059 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:48 devstack sudo[87416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bde2bebd-1a49-4527-b23e-85f2f15b1059 Apr 07 06:11:48 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:48 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c" returned: 0 in 0.747s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:11:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d84fef4c-d93f-4fe3-bbe4-1b36802ea166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65a458de-e456-40ee-9d6c-05614d89d56c', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b40575-e601-4887-8be9-2a9208032fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:48 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Volume volume-65a458de-e456-40ee-9d6c-05614d89d56c (65a458de-e456-40ee-9d6c-05614d89d56c): created successfully Apr 07 06:11:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b40575-e601-4887-8be9-2a9208032fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Flow 'volume_create_manager' (db1581ac-d7d2-40f4-afc3-7ece9802330a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:48 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-ba314325-f39b-48ae-a163-eb517e22f85e tempest-VolumesSnapshotTestJSON-1002577997 None] Created volume successfully. Apr 07 06:11:48 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bde2bebd-1a49-4527-b23e-85f2f15b1059" returned: 0 in 0.729s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] Lock "cinder-quobyte-bde2bebd-1a49-4527-b23e-85f2f15b1059" released by "delete_volume" :: held 1.680s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:49 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] Created reservations ['eaf5c854-5159-4040-a640-780b35e1605e', '64399207-71b6-43c6-9cdf-b4e6f1d6da8c', 'bef097d9-10ff-4752-826e-7a2089decc21', '0dc6c348-e198-4793-8b41-533dc1f033db'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:49 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:49 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:49 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:11:49 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:49 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] Acquiring lock "cinder-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:49 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] Lock "cinder-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:49 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] Acquiring lock "cinder-quobyte-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:49 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] Lock "cinder-quobyte-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a" acquired by "delete_volume" :: waited 0.030s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:49 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e078f9-5bdb-41a0-b1db-d8100a5a146a]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:49 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.755s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:49 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:49 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] Deleted volume successfully. Apr 07 06:11:49 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a Apr 07 06:11:49 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:49 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d126fc11-f4f4-482e-949e-2457c7e3c769 tempest-VolumesListAdminTestJSON-5094963 None] Lock "cinder-bde2bebd-1a49-4527-b23e-85f2f15b1059-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a053e2c8-b542-4e53-a084-7397fd0e71b1 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a053e2c8-b542-4e53-a084-7397fd0e71b1 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:50 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-a053e2c8-b542-4e53-a084-7397fd0e71b1 tempest-VolumesSnapshotTestJSON-1002577997 None] Creating offline snapshot 08e693c4-1f30-42f3-85e5-8be4842d3fad of volume 65a458de-e456-40ee-9d6c-05614d89d56c {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:11:50 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3aa45c-982c-4a83-b269-424a1320b03e]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a053e2c8-b542-4e53-a084-7397fd0e71b1 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:50 devstack sudo[87429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c Apr 07 06:11:50 devstack sudo[87429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:50 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a" returned: 0 in 0.826s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:50 devstack sudo[87434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a Apr 07 06:11:50 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:50 devstack sudo[87429]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a053e2c8-b542-4e53-a084-7397fd0e71b1 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c" returned: 0 in 0.794s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a053e2c8-b542-4e53-a084-7397fd0e71b1 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:50 devstack sudo[87442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad 1G Apr 07 06:11:50 devstack sudo[87442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:51 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a" returned: 0 in 0.719s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] Lock "cinder-quobyte-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a" released by "delete_volume" :: held 1.600s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:51 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] Created reservations ['98b3de0a-ecde-460e-858f-e5904a23df69', 'bfd23024-27e0-4de1-8775-d7cac4c10be2', 'd5b62f32-3b0f-41dd-8754-84ff9f61e877', '6d1149b4-e1aa-4b2a-8703-33ea38fd72f5'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:11:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:51 devstack sudo[87445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:11:51 devstack sudo[87445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:51 devstack sudo[87442]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a053e2c8-b542-4e53-a084-7397fd0e71b1 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad 1G" returned: 0 in 0.804s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a053e2c8-b542-4e53-a084-7397fd0e71b1 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65a458de-e456-40ee-9d6c-05614d89d56c -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:51 devstack sudo[87451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65a458de-e456-40ee-9d6c-05614d89d56c -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad Apr 07 06:11:51 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:51 devstack cinder-volume[82475]: DEBUG oslo_service.periodic_task [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82475) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:11:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:51 devstack sudo[87454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:11:51 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:52 devstack sudo[87445]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.627s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:52 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:52 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] Deleted volume successfully. Apr 07 06:11:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-de8a0c8a-cdfc-45ac-bdb6-f77b7333ef5d tempest-VolumesListAdminTestJSON-5094963 None] Lock "cinder-b12cce3e-c6ba-43da-b9a1-ab2f625d8a9a-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:11:52 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a053e2c8-b542-4e53-a084-7397fd0e71b1 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65a458de-e456-40ee-9d6c-05614d89d56c -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad" returned: 0 in 0.665s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:52 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-a053e2c8-b542-4e53-a084-7397fd0e71b1 tempest-VolumesSnapshotTestJSON-1002577997 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad is being set with open permissions: ugo+rw Apr 07 06:11:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a053e2c8-b542-4e53-a084-7397fd0e71b1 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:52 devstack sudo[87460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad Apr 07 06:11:52 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:52 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.655s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:52 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:11:52 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a053e2c8-b542-4e53-a084-7397fd0e71b1 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad" returned: 0 in 0.515s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a053e2c8-b542-4e53-a084-7397fd0e71b1 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:52 devstack sudo[87464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.info Apr 07 06:11:52 devstack sudo[87464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:53 devstack sudo[87464]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a053e2c8-b542-4e53-a084-7397fd0e71b1 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.info" returned: 0 in 0.567s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:53 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-a053e2c8-b542-4e53-a084-7397fd0e71b1 tempest-VolumesSnapshotTestJSON-1002577997 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.info is being set with open permissions: ugo+rw Apr 07 06:11:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a053e2c8-b542-4e53-a084-7397fd0e71b1 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:53 devstack sudo[87467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.info Apr 07 06:11:53 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:54 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a053e2c8-b542-4e53-a084-7397fd0e71b1 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.info" returned: 0 in 0.569s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a053e2c8-b542-4e53-a084-7397fd0e71b1 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.992s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:54 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-a053e2c8-b542-4e53-a084-7397fd0e71b1 tempest-VolumesSnapshotTestJSON-1002577997 None] Create snapshot completed successfully Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Flow 'volume_create_manager' (25d06d6c-7d30-4df5-bd16-bd4fb6b61b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72bd416a-e0c3-4d57-b9a5-d3489f0f9087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72bd416a-e0c3-4d57-b9a5-d3489f0f9087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1678303504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab7a812-0fe3-4452-9300-1a76741dd142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f50b24f24b8845d2af1918ddf3155eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=08e693c4-1f30-42f3-85e5-8be4842d3fad,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:11:55Z,use_quota=True,user_id='a58a160e2ff64d07b2d609cf947691b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e850f2-7219-4dae-95c1-4a1ecdfcc93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e850f2-7219-4dae-95c1-4a1ecdfcc93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (479a3a02-7e38-47b5-8916-f90c43d4bfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (479a3a02-7e38-47b5-8916-f90c43d4bfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bab7a812-0fe3-4452-9300-1a76741dd142', 'volume_name': 'volume-bab7a812-0fe3-4452-9300-1a76741dd142', 'volume_size': 1, 'snapshot_id': '08e693c4-1f30-42f3-85e5-8be4842d3fad'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4462ff39-1af5-4b99-b7b7-d73242bd5e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4462ff39-1af5-4b99-b7b7-d73242bd5e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6c6941-e029-4480-afb0-85326cf47966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:11:54 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Volume bab7a812-0fe3-4452-9300-1a76741dd142: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bab7a812-0fe3-4452-9300-1a76741dd142', 'volume_size': 1, 'snapshot_id': '08e693c4-1f30-42f3-85e5-8be4842d3fad'} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-quobyte-08e693c4-1f30-42f3-85e5-8be4842d3fad-bab7a812-0fe3-4452-9300-1a76741dd142" by "_create_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-08e693c4-1f30-42f3-85e5-8be4842d3fad-bab7a812-0fe3-4452-9300-1a76741dd142" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Creating volume bab7a812-0fe3-4452-9300-1a76741dd142 from snapshot 08e693c4-1f30-42f3-85e5-8be4842d3fad {{(pid=82475) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-quobyte-bab7a812-0fe3-4452-9300-1a76741dd142" by "_copy_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-bab7a812-0fe3-4452-9300-1a76741dd142" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] snapshot: 08e693c4-1f30-42f3-85e5-8be4842d3fad, volume: bab7a812-0fe3-4452-9300-1a76741dd142, {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[40290c3a-2942-4047-afad-435240959916]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:54 devstack sudo[87470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad Apr 07 06:11:54 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:55 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad" returned: 0 in 0.577s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65a458de-e456-40ee-9d6c-05614d89d56c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:11:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] will copy from snapshot at /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:11:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Creating direct copy from snapshot {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:11:55 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca87124-7530-4b2f-8e21-43c30316d165]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:55 devstack sudo[87478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c Apr 07 06:11:55 devstack sudo[87478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:56 devstack sudo[87478]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c" returned: 0 in 0.678s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:56 devstack cinder-volume[82475]: DEBUG cinder.utils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Path /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bab7a812-0fe3-4452-9300-1a76741dd142 not found in is_blk_device check {{(pid=82475) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:11:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bab7a812-0fe3-4452-9300-1a76741dd142 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:56 devstack sudo[87483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bab7a812-0fe3-4452-9300-1a76741dd142 Apr 07 06:11:56 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:11:59 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root Apr 07 06:11:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bab7a812-0fe3-4452-9300-1a76741dd142" returned: 0 in 3.325s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:11:59 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[9691e955-fdef-4b41-91f0-e4af52f6f50f]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:11:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:11:59 devstack sudo[87538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c Apr 07 06:11:59 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:00 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Flow 'volume_create_manager' (1c2c0f40-ff90-4d69-9a22-5e9e4c8e3d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f156e333-f22c-4c3b-aec2-4a9435d93083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f156e333-f22c-4c3b-aec2-4a9435d93083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1141868296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d82293-4dc8-4a51-8785-2b69d855bdd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b164fb703b3458a87387f7f314205ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:00Z,use_quota=True,user_id='abcbaa7507f44330a31b282cf21706c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d226472d-eb6b-4326-8dc1-8cb6dae34cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d226472d-eb6b-4326-8dc1-8cb6dae34cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1afd27-2671-4e7c-b64a-44045eabf792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[82475]: DEBUG cinder.image.glance [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Creating Keystone auth plugin from conf {{(pid=82475) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 07 06:12:00 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c" returned: 0 in 1.021s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:00 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Image conversion details: src /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c, size 1024.00 MB, duration 3.33 sec, destination /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bab7a812-0fe3-4452-9300-1a76741dd142 {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:12:00 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Converted 1024.00 MB image at 307.64 MB/s Apr 07 06:12:00 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bab7a812-0fe3-4452-9300-1a76741dd142 is being set with open permissions: ugo+rw Apr 07 06:12:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bab7a812-0fe3-4452-9300-1a76741dd142 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:00 devstack sudo[87545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bab7a812-0fe3-4452-9300-1a76741dd142 Apr 07 06:12:00 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1afd27-2671-4e7c-b64a-44045eabf792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '82d82293-4dc8-4a51-8785-2b69d855bdd0', 'volume_name': 'volume-82d82293-4dc8-4a51-8785-2b69d855bdd0', 'volume_size': 1, 'image_id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b1699f15f0f4ed99342800159112237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e597d39-f7d0-437d-988f-e2351ab702ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89c63e4-86a0-4238-a72f-ab81150b2c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89c63e4-86a0-4238-a72f-ab81150b2c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801311df-91d9-4b29-acfd-a25c66b563dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:00 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Volume 82d82293-4dc8-4a51-8785-2b69d855bdd0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-82d82293-4dc8-4a51-8785-2b69d855bdd0', 'volume_size': 1, 'image_id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b1699f15f0f4ed99342800159112237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e597d39-f7d0-437d-988f-e2351ab702ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 07 06:12:00 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Trying to clone 82d82293-4dc8-4a51-8785-2b69d855bdd0 from image 2e597d39-f7d0-437d-988f-e2351ab702ec at location (None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}]). {{(pid=82475) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 07 06:12:00 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_b7_kqtbbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82475) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 07 06:12:00 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Image download 20.69 MB at 20.69 MB/s Apr 07 06:12:00 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfededc-a39b-40df-91c3-28747d25bc4e]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_b7_kqtbbdevstack@QuobyteHD {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:00 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_b7_kqtbbdevstack@QuobyteHD Apr 07 06:12:00 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:01 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bab7a812-0fe3-4452-9300-1a76741dd142" returned: 0 in 0.554s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-bab7a812-0fe3-4452-9300-1a76741dd142" released by "_copy_volume_from_snapshot" :: held 6.265s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-08e693c4-1f30-42f3-85e5-8be4842d3fad-bab7a812-0fe3-4452-9300-1a76741dd142" released by "_create_volume_from_snapshot" :: held 6.292s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.303s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6c6941-e029-4480-afb0-85326cf47966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bab7a812-0fe3-4452-9300-1a76741dd142', 'volume_size': 1, 'snapshot_id': '08e693c4-1f30-42f3-85e5-8be4842d3fad'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9748711d-2508-4687-802b-f6208cb17b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:01 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Volume volume-bab7a812-0fe3-4452-9300-1a76741dd142 (bab7a812-0fe3-4452-9300-1a76741dd142): created successfully Apr 07 06:12:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9748711d-2508-4687-802b-f6208cb17b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Flow 'volume_create_manager' (25d06d6c-7d30-4df5-bd16-bd4fb6b61b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:01 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-88456bb9-dec8-4361-ad76-8a61987fe135 tempest-VolumesSnapshotTestJSON-1002577997 None] Created volume successfully. Apr 07 06:12:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-bab7a812-0fe3-4452-9300-1a76741dd142-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-bab7a812-0fe3-4452-9300-1a76741dd142-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:01 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_b7_kqtbbdevstack@QuobyteHD" returned: 0 in 0.583s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:01 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Temporary image 2e597d39-f7d0-437d-988f-e2351ab702ec is fetched for user abcbaa7507f44330a31b282cf21706c2. {{(pid=82475) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 07 06:12:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-quobyte-bab7a812-0fe3-4452-9300-1a76741dd142" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-bab7a812-0fe3-4452-9300-1a76741dd142" acquired by "delete_volume" :: waited 0.044s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:01 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f79e12e-55d3-4e41-b173-e03e12aa6469]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bab7a812-0fe3-4452-9300-1a76741dd142 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:01 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2871f9-7dbe-455d-aaa8-9cd765641e80]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_b7_kqtbbdevstack@QuobyteHD {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:01 devstack sudo[87558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bab7a812-0fe3-4452-9300-1a76741dd142 Apr 07 06:12:01 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:01 devstack sudo[87559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_b7_kqtbbdevstack@QuobyteHD Apr 07 06:12:01 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:02 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bab7a812-0fe3-4452-9300-1a76741dd142" returned: 0 in 0.812s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bab7a812-0fe3-4452-9300-1a76741dd142 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:02 devstack sudo[87569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bab7a812-0fe3-4452-9300-1a76741dd142 Apr 07 06:12:02 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:02 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_b7_kqtbbdevstack@QuobyteHD" returned: 0 in 0.898s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1141868296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d82293-4dc8-4a51-8785-2b69d855bdd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b164fb703b3458a87387f7f314205ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:00Z,use_quota=True,user_id='abcbaa7507f44330a31b282cf21706c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Creating volume 82d82293-4dc8-4a51-8785-2b69d855bdd0 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:02 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:02 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 1073741824 Apr 07 06:12:02 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:02 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bab7a812-0fe3-4452-9300-1a76741dd142" returned: 0 in 0.500s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-bab7a812-0fe3-4452-9300-1a76741dd142" released by "delete_volume" :: held 1.382s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] Created reservations ['37ef2f20-4cdf-43df-8d94-31ba55dea980', '3eeb9a73-07d4-4b7a-9b11-d3eee2d95cf3', '16af92a6-c886-42c0-9199-1dd35c82e038', 'a8edcbba-be43-413d-b018-4bdd18090f09'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:03 devstack sudo[87590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:03 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:03 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 1073741824" returned: 0 in 0.669s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:03 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 Apr 07 06:12:03 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:03 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.611s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:03 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] Deleted volume successfully. Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-db3303ab-c547-45a4-9bf6-66a5179cf988 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-bab7a812-0fe3-4452-9300-1a76741dd142-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-08e693c4-1f30-42f3-85e5-8be4842d3fad-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-08e693c4-1f30-42f3-85e5-8be4842d3fad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-quobyte-65a458de-e456-40ee-9d6c-05614d89d56c" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-65a458de-e456-40ee-9d6c-05614d89d56c" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-quobyte-08e693c4-1f30-42f3-85e5-8be4842d3fad" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-08e693c4-1f30-42f3-85e5-8be4842d3fad" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] Deleting offline snapshot 08e693c4-1f30-42f3-85e5-8be4842d3fad of volume 65a458de-e456-40ee-9d6c-05614d89d56c {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] snapshot_file for this snap is: volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[9604ab9d-b673-4c25-ad78-92a11aa8de8c]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:03 devstack sudo[87625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad Apr 07 06:12:03 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:03 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0" returned: 0 in 0.687s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG cinder.volume.volume_utils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Attempting download of 2e597d39-f7d0-437d-988f-e2351ab702ec ((None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}])) to volume 82d82293-4dc8-4a51-8785-2b69d855bdd0. {{(pid=82475) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cb90e9-a22e-4986-b9c5-cd05e5fbc331]: (4, 'raw') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_ck2rj_tz {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:03 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_ck2rj_tz Apr 07 06:12:03 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:04 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad" returned: 0 in 0.572s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:04 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65a458de-e456-40ee-9d6c-05614d89d56c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:12:04 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[1053813f-13f5-470c-a11c-f129f43ac0ff]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:04 devstack sudo[87634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c Apr 07 06:12:04 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:04 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_ck2rj_tz" returned: 0 in 0.633s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_ck2rj_tz {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:04 devstack sudo[87641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_ck2rj_tz Apr 07 06:12:04 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:04 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c" returned: 0 in 0.604s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:04 devstack sudo[87646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad Apr 07 06:12:04 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:05 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_ck2rj_tz" returned: 1 in 0.628s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_ck2rj_tz' failed. Not Retrying. {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:12:05 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[8457396a-8989-44dd-ba32-b59a209db611]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_b7_kqtbbdevstack@QuobyteHD {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:05 devstack sudo[87679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_b7_kqtbbdevstack@QuobyteHD Apr 07 06:12:05 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:05 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad" returned: 0 in 0.866s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:05 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad Apr 07 06:12:05 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:05 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_b7_kqtbbdevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:05 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] 2e597d39-f7d0-437d-988f-e2351ab702ec was qcow2, converting to raw {{(pid=82475) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 07 06:12:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_b7_kqtbbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:05 devstack sudo[87693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_b7_kqtbbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 Apr 07 06:12:05 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:06 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c.08e693c4-1f30-42f3-85e5-8be4842d3fad" returned: 0 in 0.552s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:06 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-08e693c4-1f30-42f3-85e5-8be4842d3fad" released by "_delete_snapshot" :: held 2.657s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:06 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-65a458de-e456-40ee-9d6c-05614d89d56c" released by "delete_snapshot" :: held 2.676s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:06 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] Created reservations ['8072638e-7429-4318-a10b-4650beb87d08', '4f3f4d55-c4f0-4e52-b55e-5d229d3f274c', '5d929890-e91a-4b6b-840c-7c9c242b18ca', '1c36061a-5a9d-435a-8f6c-6e22e1dde2ce'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:06 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] Delete snapshot completed successfully. Apr 07 06:12:06 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3213e97a-9cf8-4749-9e83-29c832c81e8b tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-08e693c4-1f30-42f3-85e5-8be4842d3fad-delete_snapshot" released by "delete_snapshot" :: held 2.798s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:06 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-65a458de-e456-40ee-9d6c-05614d89d56c-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:06 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-65a458de-e456-40ee-9d6c-05614d89d56c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-quobyte-65a458de-e456-40ee-9d6c-05614d89d56c" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-65a458de-e456-40ee-9d6c-05614d89d56c" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aa991a-5506-44eb-8d2b-74660ea03166]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:07 devstack sudo[87711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c Apr 07 06:12:07 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:07 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_b7_kqtbbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0" returned: 0 in 1.198s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_b7_kqtbbdevstack@QuobyteHD, size 112.00 MB, duration 1.20 sec, destination /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:12:07 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Converted 112.00 MB image at 93.37 MB/s Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:07 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 1G Apr 07 06:12:07 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Flow 'volume_create_manager' (4f306d7d-96d1-4df9-84ba-ae22ee1e11c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341239a7-084a-45ba-be10-3ae82102c0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341239a7-084a-45ba-be10-3ae82102c0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1950831052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f86296f-4bdc-4596-a94a-8b1eb5bc79e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056dc663fbc246cb81fe7ef44d880d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:08Z,use_quota=True,user_id='d7726e11612e41b9918305f81a17604a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0febe01-6b51-4875-94ec-fe7165ef4cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0febe01-6b51-4875-94ec-fe7165ef4cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3b7c4d-1eb1-47a0-8bea-2cd1a5ab2fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3b7c4d-1eb1-47a0-8bea-2cd1a5ab2fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f86296f-4bdc-4596-a94a-8b1eb5bc79e8', 'volume_name': 'volume-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e51d687-33e0-4581-9d3b-0767b6700dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e51d687-33e0-4581-9d3b-0767b6700dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1375a957-75b8-4cb5-9c9a-7708cbc7ae9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:07 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Volume 5f86296f-4bdc-4596-a94a-8b1eb5bc79e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8', 'volume_size': 1} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1950831052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f86296f-4bdc-4596-a94a-8b1eb5bc79e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056dc663fbc246cb81fe7ef44d880d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:08Z,use_quota=True,user_id='d7726e11612e41b9918305f81a17604a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Creating volume 5f86296f-4bdc-4596-a94a-8b1eb5bc79e8 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:07 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:07 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8 1073741824 Apr 07 06:12:07 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:07 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c" returned: 0 in 0.737s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:07 devstack sudo[87725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c Apr 07 06:12:07 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:07 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 1G" returned: 0 in 0.701s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b766974-3b91-4e5f-a2f0-7a0f994a9e74]: (4, 'raw') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:07 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 Apr 07 06:12:07 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:08 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65a458de-e456-40ee-9d6c-05614d89d56c" returned: 0 in 0.533s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-65a458de-e456-40ee-9d6c-05614d89d56c" released by "delete_volume" :: held 1.304s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:08 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] Created reservations ['26eaf945-abdd-4c8d-ac00-4ee2ccc5dec2', '0d70a58d-f0d9-4709-a900-724b6e9a8a79', '0a739eac-1743-4865-b22e-1797dc98e928', '7f9a3708-b19d-48d4-bd7c-6ebdab70b1d8'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:08 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:08 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:08 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8 1073741824" returned: 0 in 0.761s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:08 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0" returned: 0 in 0.636s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:08 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8 Apr 07 06:12:08 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:08 devstack sudo[87738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 Apr 07 06:12:08 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:09 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.634s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:09 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] Deleted volume successfully. Apr 07 06:12:09 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8" returned: 0 in 0.583s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1375a957-75b8-4cb5-9c9a-7708cbc7ae9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3765ba58-073e-45da-82ce-38893b74031f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e12ee8dc-5d41-472f-8f88-b4e450fa7711 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-65a458de-e456-40ee-9d6c-05614d89d56c-delete_volume" released by "delete_volume" :: held 2.161s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:09 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Volume volume-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8 (5f86296f-4bdc-4596-a94a-8b1eb5bc79e8): created successfully Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3765ba58-073e-45da-82ce-38893b74031f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Flow 'volume_create_manager' (4f306d7d-96d1-4df9-84ba-ae22ee1e11c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:09 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-8549edc5-d17f-42dd-bfac-0a0a645d5940 tempest-VolumesActionsTest-1898711442 None] Created volume successfully. Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-53dcaa00-ea79-48cd-9d23-b3f46e6a5652-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-53dcaa00-ea79-48cd-9d23-b3f46e6a5652-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "cinder-quobyte-53dcaa00-ea79-48cd-9d23-b3f46e6a5652" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-53dcaa00-ea79-48cd-9d23-b3f46e6a5652" acquired by "delete_volume" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:09 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[351dfda2-85a4-43ec-95f7-5b2250d08f33]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0" returned: 1 in 0.840s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0' failed. Not Retrying. {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.volume.volume_utils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Downloaded image 2e597d39-f7d0-437d-988f-e2351ab702ec ((None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}])) to volume 82d82293-4dc8-4a51-8785-2b69d855bdd0 successfully. {{(pid=82475) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Temporary image 2e597d39-f7d0-437d-988f-e2351ab702ec for user abcbaa7507f44330a31b282cf21706c2 is deleted. {{(pid=82475) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.volume.volume_utils [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Marking volume 82d82293-4dc8-4a51-8785-2b69d855bdd0 as bootable. {{(pid=82475) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Copying metadata from image 2e597d39-f7d0-437d-988f-e2351ab702ec to 82d82293-4dc8-4a51-8785-2b69d855bdd0. {{(pid=82475) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Creating volume glance metadata for volume 82d82293-4dc8-4a51-8785-2b69d855bdd0 backed by image 2e597d39-f7d0-437d-988f-e2351ab702ec with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82475) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 07 06:12:09 devstack sudo[87746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652 Apr 07 06:12:09 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801311df-91d9-4b29-acfd-a25c66b563dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82d82293-4dc8-4a51-8785-2b69d855bdd0', 'volume_size': 1, 'image_id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b1699f15f0f4ed99342800159112237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e597d39-f7d0-437d-988f-e2351ab702ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882411c7-3dd9-4984-b2b4-570e3d76c446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:09 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Volume volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 (82d82293-4dc8-4a51-8785-2b69d855bdd0): created successfully Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882411c7-3dd9-4984-b2b4-570e3d76c446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Flow 'volume_create_manager' (1c2c0f40-ff90-4d69-9a22-5e9e4c8e3d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:09 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-b0dc11c6-9120-4c3f-a43c-c28e96204565 tempest-VolumesImageMetadata-447187835 None] Created volume successfully. Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a525a094-7a04-4a5e-b683-f9b8537cc116 tempest-VolumesActionsTest-1898711442 None] Acquiring lock "cinder-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8" by "attach_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a525a094-7a04-4a5e-b683-f9b8537cc116 tempest-VolumesActionsTest-1898711442 None] Lock "cinder-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8" acquired by "attach_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:09 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-a525a094-7a04-4a5e-b683-f9b8537cc116 tempest-VolumesActionsTest-1898711442 None] Attaching volume 5f86296f-4bdc-4596-a94a-8b1eb5bc79e8 to instance 2837f123-b792-48cb-b3cb-2926446f3378 at mountpoint /dev/vdb on host None. Apr 07 06:12:09 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652" returned: 0 in 0.602s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:09 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-a525a094-7a04-4a5e-b683-f9b8537cc116 tempest-VolumesActionsTest-1898711442 None] Attach volume completed successfully. Apr 07 06:12:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-a525a094-7a04-4a5e-b683-f9b8537cc116 tempest-VolumesActionsTest-1898711442 None] Lock "cinder-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8" released by "attach_volume" :: held 0.253s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:10 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652 Apr 07 06:12:10 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:10 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] Acquiring lock "cinder-82d82293-4dc8-4a51-8785-2b69d855bdd0-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:10 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] Lock "cinder-82d82293-4dc8-4a51-8785-2b69d855bdd0-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:10 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] Acquiring lock "cinder-quobyte-82d82293-4dc8-4a51-8785-2b69d855bdd0" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:10 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] Lock "cinder-quobyte-82d82293-4dc8-4a51-8785-2b69d855bdd0" acquired by "delete_volume" :: waited 0.015s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:10 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[973f451a-a455-4afb-8953-743709f3baac]: (4, 'raw') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:10 devstack sudo[87755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 Apr 07 06:12:10 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:10 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-53dcaa00-ea79-48cd-9d23-b3f46e6a5652" returned: 0 in 0.841s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:10 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-quobyte-53dcaa00-ea79-48cd-9d23-b3f46e6a5652" released by "delete_volume" :: held 1.478s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:10 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] Created reservations ['04f6b0cc-b70b-47ba-a347-b185c1c4b9f8', '36067b03-bd94-4969-9de4-ef6e70d4f277', '265fe837-71ec-48b3-aa85-b45745e802c4', '2425ef27-e054-4f07-ba75-0b90a6da0c6f'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:10 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-5bd3fbb0-e06d-4be7-b09e-eafd719a8ab3 tempest-VolumesActionsTest-860442081 None] Terminate volume connection completed successfully. Apr 07 06:12:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:11 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:11 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:11 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:11 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:11 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0" returned: 0 in 0.781s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:11 devstack sudo[87763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 Apr 07 06:12:11 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5bd3fbb0-e06d-4be7-b09e-eafd719a8ab3 tempest-VolumesActionsTest-860442081 None] Acquiring lock "cinder-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8-detach_volume" by "detach_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5bd3fbb0-e06d-4be7-b09e-eafd719a8ab3 tempest-VolumesActionsTest-860442081 None] Lock "cinder-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:11 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-5bd3fbb0-e06d-4be7-b09e-eafd719a8ab3 tempest-VolumesActionsTest-860442081 None] Detaching volume 5f86296f-4bdc-4596-a94a-8b1eb5bc79e8 from instance 2837f123-b792-48cb-b3cb-2926446f3378. Apr 07 06:12:11 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-5bd3fbb0-e06d-4be7-b09e-eafd719a8ab3 tempest-VolumesActionsTest-860442081 None] Detach volume completed successfully. Apr 07 06:12:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5bd3fbb0-e06d-4be7-b09e-eafd719a8ab3 tempest-VolumesActionsTest-860442081 None] Lock "cinder-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:11 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.674s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:11 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:11 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] Deleted volume successfully. Apr 07 06:12:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-9749eb76-20a3-4491-8ccb-466c1da268f1 tempest-VolumesSnapshotTestJSON-1002577997 None] Lock "cinder-53dcaa00-ea79-48cd-9d23-b3f46e6a5652-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:11 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0" returned: 1 in 0.680s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0' failed. Not Retrying. {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:12:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:11 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0 Apr 07 06:12:11 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2001a1aa-d873-4100-ba83-bc4f5feda572 tempest-VolumesActionsTest-1898711442 None] Acquiring lock "cinder-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8-detach_volume" by "detach_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2001a1aa-d873-4100-ba83-bc4f5feda572 tempest-VolumesActionsTest-1898711442 None] Lock "cinder-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:12 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-2001a1aa-d873-4100-ba83-bc4f5feda572 tempest-VolumesActionsTest-1898711442 None] Volume detach called, but volume not attached. Apr 07 06:12:12 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:UPDATE=158,cinder:DELETE=18,cinder:SELECT=156,cinder:INSERT=43 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:12:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-2001a1aa-d873-4100-ba83-bc4f5feda572 tempest-VolumesActionsTest-1898711442 None] Lock "cinder-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:12 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-82d82293-4dc8-4a51-8785-2b69d855bdd0" returned: 0 in 0.630s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] Lock "cinder-quobyte-82d82293-4dc8-4a51-8785-2b69d855bdd0" released by "delete_volume" :: held 2.194s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:12 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:UPDATE=183,cinder:SELECT=146,cinder:DELETE=12,cinder:INSERT=55 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:12:12 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] Created reservations ['2597f9bd-1832-4081-b8f4-1a37b1d919ad', 'd3968003-0271-40f1-95ac-9e5b8feeffbc', 'f4cf1215-b63d-43eb-8df5-3090d5613b8c', '77b5bf0e-b246-43a7-98b7-5df712883f84'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:12 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:12 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:12 devstack sudo[87772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:12 devstack sudo[87772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] Acquiring lock "cinder-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] Lock "cinder-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] Acquiring lock "cinder-quobyte-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] Lock "cinder-quobyte-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8" acquired by "delete_volume" :: waited 0.021s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:13 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[269d1fa5-9817-4144-81e5-ba7b63b32200]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:13 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8 Apr 07 06:12:13 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:13 devstack sudo[87772]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.993s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:13 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:13 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] Deleted volume successfully. Apr 07 06:12:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-da0932f9-3526-4a77-b757-b082954e37e6 tempest-VolumesImageMetadata-447187835 None] Lock "cinder-82d82293-4dc8-4a51-8785-2b69d855bdd0-delete_volume" released by "delete_volume" :: held 3.464s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:14 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8" returned: 0 in 1.059s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:14 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8 Apr 07 06:12:14 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] Acquiring lock "cinder-ef5564d5-1da3-4e39-8a45-508e66bdc76d-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] Lock "cinder-ef5564d5-1da3-4e39-8a45-508e66bdc76d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] Acquiring lock "cinder-quobyte-ef5564d5-1da3-4e39-8a45-508e66bdc76d" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] Lock "cinder-quobyte-ef5564d5-1da3-4e39-8a45-508e66bdc76d" acquired by "delete_volume" :: waited 0.019s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:14 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b75572-28d7-4de7-ace2-8c53e18a59bd]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ef5564d5-1da3-4e39-8a45-508e66bdc76d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:15 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ef5564d5-1da3-4e39-8a45-508e66bdc76d Apr 07 06:12:15 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:15 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8" returned: 0 in 0.810s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:15 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] Lock "cinder-quobyte-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8" released by "delete_volume" :: held 1.900s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:15 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] Created reservations ['a3323f70-34cb-49a9-adb0-4cd92c45d953', 'fa6f942c-ca05-4e17-a983-7ba557b4acb3', '77bd03d7-bcfb-4a48-9a2a-19dcb6bd7934', '79b878b4-5c82-4d9e-919c-6e1fda476cbd'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:15 devstack sudo[87786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:15 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:16 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ef5564d5-1da3-4e39-8a45-508e66bdc76d" returned: 0 in 1.618s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ef5564d5-1da3-4e39-8a45-508e66bdc76d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:16 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ef5564d5-1da3-4e39-8a45-508e66bdc76d Apr 07 06:12:16 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:16 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 1.611s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:16 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:16 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] Deleted volume successfully. Apr 07 06:12:17 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e9e88a62-9530-4df5-ad6d-96ced5118f24 tempest-VolumesActionsTest-1898711442 None] Lock "cinder-5f86296f-4bdc-4596-a94a-8b1eb5bc79e8-delete_volume" released by "delete_volume" :: held 3.961s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:17 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ef5564d5-1da3-4e39-8a45-508e66bdc76d" returned: 0 in 0.864s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:17 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] Lock "cinder-quobyte-ef5564d5-1da3-4e39-8a45-508e66bdc76d" released by "delete_volume" :: held 2.524s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:17 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] Created reservations ['8616790d-cb34-4d14-94cb-3e5e12aaeafd', '836654b0-024e-4d06-873d-cdcbe70e52a9', 'd134cfe2-bc82-4758-bba0-7fb8e2f81b41', 'a3e28812-de17-432b-8de6-ebd956ec9489'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:17 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:17 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:18 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.746s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:18 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:18 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] Deleted volume successfully. Apr 07 06:12:18 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-05d90f82-633f-4594-b4e5-6d2d907d46a5 tempest-VolumesNegativeTest-1194753037 None] Lock "cinder-ef5564d5-1da3-4e39-8a45-508e66bdc76d-delete_volume" released by "delete_volume" :: held 3.606s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Flow 'volume_create_manager' (dc2deb01-81fc-4142-964b-71e6dcd970f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7257cc-11fe-4053-a6f2-c9b088894fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7257cc-11fe-4053-a6f2-c9b088894fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1247873882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5d958f-2e99-4e21-8713-d522ac220c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='063c48d515fb44288c72777211b76dc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:19Z,use_quota=True,user_id='8ca3aeefdd1a43a0a67ed3c8c1cb1e5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687d3d7e-1ce3-454b-bd1a-d163d1cf7a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687d3d7e-1ce3-454b-bd1a-d163d1cf7a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1852c392-6179-4d36-aff6-98e02dc5288d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1852c392-6179-4d36-aff6-98e02dc5288d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd5d958f-2e99-4e21-8713-d522ac220c12', 'volume_name': 'volume-dd5d958f-2e99-4e21-8713-d522ac220c12', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e843a5e9-3548-4608-a702-c886f9f78be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e843a5e9-3548-4608-a702-c886f9f78be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1916797-6ba9-4c6a-aacd-9fb7f3ded4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:19 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Volume dd5d958f-2e99-4e21-8713-d522ac220c12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd5d958f-2e99-4e21-8713-d522ac220c12', 'volume_size': 1} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1247873882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5d958f-2e99-4e21-8713-d522ac220c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='063c48d515fb44288c72777211b76dc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:19Z,use_quota=True,user_id='8ca3aeefdd1a43a0a67ed3c8c1cb1e5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Creating volume dd5d958f-2e99-4e21-8713-d522ac220c12 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:19 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd5d958f-2e99-4e21-8713-d522ac220c12 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:19 devstack sudo[87865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd5d958f-2e99-4e21-8713-d522ac220c12 1073741824 Apr 07 06:12:19 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Flow 'volume_create_manager' (4dd272c6-bea2-4be7-959d-d41cd2ee95e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47baed9-b0e2-4421-b75c-14178b7f976a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47baed9-b0e2-4421-b75c-14178b7f976a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1840642878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fde5fd3-b983-493c-a3ee-107a3acc2bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202469865de44f2ca67d59c7d170f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:20Z,use_quota=True,user_id='95eea4452915475fb0af2018360f0ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2394ebe6-46ae-4563-a50d-65de87177761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2394ebe6-46ae-4563-a50d-65de87177761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469461c9-21ac-48e4-a2dc-782592f9ee4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469461c9-21ac-48e4-a2dc-782592f9ee4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fde5fd3-b983-493c-a3ee-107a3acc2bb0', 'volume_name': 'volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b864b7-4d3e-4666-a700-995c1bcb0a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b864b7-4d3e-4666-a700-995c1bcb0a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2975bc7-0178-4de9-bcf4-4c60b0f74937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:19 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Volume 9fde5fd3-b983-493c-a3ee-107a3acc2bb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0', 'volume_size': 1} Apr 07 06:12:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:20 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd5d958f-2e99-4e21-8713-d522ac220c12 1073741824" returned: 0 in 0.681s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd5d958f-2e99-4e21-8713-d522ac220c12 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:20 devstack sudo[87871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd5d958f-2e99-4e21-8713-d522ac220c12 Apr 07 06:12:20 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Flow 'volume_create_manager' (1498edc3-24ae-4ee5-843b-13c45fb6b486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5c07d5-7d14-4dba-8f1a-a66b493cc543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5c07d5-7d14-4dba-8f1a-a66b493cc543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-32815827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52378b05-8b9a-413b-b6ec-0ac59bbdbaab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b2ab7413d844c49edf3d928c153672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:21Z,use_quota=True,user_id='4257cef4acb84deabf650437c3004d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d839872-d1ee-4d1e-bdfe-b5313a01e6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d839872-d1ee-4d1e-bdfe-b5313a01e6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63863227-30e2-4662-9d08-441f0df06095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63863227-30e2-4662-9d08-441f0df06095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52378b05-8b9a-413b-b6ec-0ac59bbdbaab', 'volume_name': 'volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65bbe353-eb2a-45d9-9e02-9ef03ab173d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65bbe353-eb2a-45d9-9e02-9ef03ab173d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9116b9d-ba32-4e65-bc25-1fbd2e47b3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:20 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Volume 52378b05-8b9a-413b-b6ec-0ac59bbdbaab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab', 'volume_size': 1} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:20 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd5d958f-2e99-4e21-8713-d522ac220c12" returned: 0 in 0.449s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.820s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1840642878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fde5fd3-b983-493c-a3ee-107a3acc2bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202469865de44f2ca67d59c7d170f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:20Z,use_quota=True,user_id='95eea4452915475fb0af2018360f0ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Creating volume 9fde5fd3-b983-493c-a3ee-107a3acc2bb0 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:20 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1916797-6ba9-4c6a-aacd-9fb7f3ded4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd5d958f-2e99-4e21-8713-d522ac220c12', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:20 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0 1073741824 Apr 07 06:12:20 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91cbdf7-b99b-48f4-86cd-1eae62389e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:20 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Volume volume-dd5d958f-2e99-4e21-8713-d522ac220c12 (dd5d958f-2e99-4e21-8713-d522ac220c12): created successfully Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91cbdf7-b99b-48f4-86cd-1eae62389e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:20 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Flow 'volume_create_manager' (dc2deb01-81fc-4142-964b-71e6dcd970f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:20 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-8df38fd5-b835-4c0b-b2fa-6f6c04a4f872 tempest-AbsoluteLimitsTests-1947275905 None] Created volume successfully. Apr 07 06:12:21 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0 1073741824" returned: 0 in 0.552s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:21 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0 Apr 07 06:12:21 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] Acquiring lock "cinder-dd5d958f-2e99-4e21-8713-d522ac220c12-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] Lock "cinder-dd5d958f-2e99-4e21-8713-d522ac220c12-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] Acquiring lock "cinder-quobyte-dd5d958f-2e99-4e21-8713-d522ac220c12" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] Lock "cinder-quobyte-dd5d958f-2e99-4e21-8713-d522ac220c12" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[66898f71-27cf-4932-8d99-3ab71017a28a]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd5d958f-2e99-4e21-8713-d522ac220c12 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:21 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0" returned: 0 in 0.491s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.082s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-32815827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52378b05-8b9a-413b-b6ec-0ac59bbdbaab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b2ab7413d844c49edf3d928c153672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:21Z,use_quota=True,user_id='4257cef4acb84deabf650437c3004d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Creating volume 52378b05-8b9a-413b-b6ec-0ac59bbdbaab {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:21 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:21 devstack sudo[87883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab 1073741824 Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2975bc7-0178-4de9-bcf4-4c60b0f74937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:21 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3601e67-0d98-4443-928d-a3798b8cce96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:21 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Volume volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0 (9fde5fd3-b983-493c-a3ee-107a3acc2bb0): created successfully Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3601e67-0d98-4443-928d-a3798b8cce96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:21 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Flow 'volume_create_manager' (4dd272c6-bea2-4be7-959d-d41cd2ee95e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:21 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-018a6cf1-d452-477b-907f-f9bb8bc3cbfa tempest-CreateVolumesFromSnapshotTest-471045403 None] Created volume successfully. Apr 07 06:12:21 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd5d958f-2e99-4e21-8713-d522ac220c12 Apr 07 06:12:21 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3e893e78-0950-4b97-a0a5-eaaed17a6700 tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:22 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab 1073741824" returned: 0 in 0.512s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:22 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd5d958f-2e99-4e21-8713-d522ac220c12" returned: 0 in 0.579s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd5d958f-2e99-4e21-8713-d522ac220c12 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:22 devstack sudo[87892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab Apr 07 06:12:22 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:22 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd5d958f-2e99-4e21-8713-d522ac220c12 Apr 07 06:12:22 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Flow 'volume_create_manager' (7cde14b8-ad47-4dea-a691-4d722f7504e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fbffff-860e-4ae9-a165-26108295e072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fbffff-860e-4ae9-a165-26108295e072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-9100859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfe5a4a-257d-4f37-a763-985c8744bfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056dc663fbc246cb81fe7ef44d880d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:23Z,use_quota=True,user_id='d7726e11612e41b9918305f81a17604a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57c0602-8893-458b-bcf9-2240dd70fa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57c0602-8893-458b-bcf9-2240dd70fa33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964095c5-cad5-4142-a885-8114e3cf50ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964095c5-cad5-4142-a885-8114e3cf50ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bfe5a4a-257d-4f37-a763-985c8744bfee', 'volume_name': 'volume-1bfe5a4a-257d-4f37-a763-985c8744bfee', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26785ab4-d026-41e6-abcb-393ccdafae5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26785ab4-d026-41e6-abcb-393ccdafae5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de5a5d9-331d-4906-93cf-9c6278a7add0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:22 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Volume 1bfe5a4a-257d-4f37-a763-985c8744bfee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bfe5a4a-257d-4f37-a763-985c8744bfee', 'volume_size': 1} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:22 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd5d958f-2e99-4e21-8713-d522ac220c12" returned: 0 in 0.452s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] Lock "cinder-quobyte-dd5d958f-2e99-4e21-8713-d522ac220c12" released by "delete_volume" :: held 1.057s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:22 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab" returned: 0 in 0.517s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3e893e78-0950-4b97-a0a5-eaaed17a6700 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.751s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-3e893e78-0950-4b97-a0a5-eaaed17a6700 tempest-CreateVolumesFromSnapshotTest-471045403 None] Creating offline snapshot dad6618d-da9b-489f-be2e-775753f019e0 of volume 9fde5fd3-b983-493c-a3ee-107a3acc2bb0 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9116b9d-ba32-4e65-bc25-1fbd2e47b3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319fa22a-90a3-4acf-9be7-0eb2b560e29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[a674ffb4-dd18-4264-a8b4-504c037137ec]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] Created reservations ['bd2aa783-3b34-4f87-a9d6-e055cf60a625', 'f30dab82-2322-40bf-90d2-39f16f940e01', '38e9b3b9-af3a-48fb-9885-dbbcfb22503d', 'fd7f717a-95f6-4973-b85e-7168a09eaf33'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3e893e78-0950-4b97-a0a5-eaaed17a6700 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:22 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Volume volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab (52378b05-8b9a-413b-b6ec-0ac59bbdbaab): created successfully Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319fa22a-90a3-4acf-9be7-0eb2b560e29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Flow 'volume_create_manager' (1498edc3-24ae-4ee5-843b-13c45fb6b486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:22 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-e729aa41-2dab-45c3-be87-c3fba35bc176 tempest-VolumesSnapshotListTestJSON-303684822 None] Created volume successfully. Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:22 devstack sudo[87899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:22 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:22 devstack sudo[87898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0 Apr 07 06:12:22 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:23 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.457s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:23 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:23 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] Deleted volume successfully. Apr 07 06:12:23 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3e893e78-0950-4b97-a0a5-eaaed17a6700 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0" returned: 0 in 0.541s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3e893e78-0950-4b97-a0a5-eaaed17a6700 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:23 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-324c412a-7f88-4ebc-852d-6283887d9271 tempest-AbsoluteLimitsTests-1947275905 None] Lock "cinder-dd5d958f-2e99-4e21-8713-d522ac220c12-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:23 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0 1G Apr 07 06:12:23 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:23 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3e893e78-0950-4b97-a0a5-eaaed17a6700 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0 1G" returned: 0 in 0.557s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3e893e78-0950-4b97-a0a5-eaaed17a6700 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-be7aea4d-a486-4b78-af7c-20aca978a6cd tempest-VolumesSnapshotListTestJSON-303684822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:24 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0 Apr 07 06:12:24 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:24 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3e893e78-0950-4b97-a0a5-eaaed17a6700 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0" returned: 0 in 0.524s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:24 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-3e893e78-0950-4b97-a0a5-eaaed17a6700 tempest-CreateVolumesFromSnapshotTest-471045403 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0 is being set with open permissions: ugo+rw Apr 07 06:12:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3e893e78-0950-4b97-a0a5-eaaed17a6700 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:24 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0 Apr 07 06:12:24 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:24 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3e893e78-0950-4b97-a0a5-eaaed17a6700 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0" returned: 0 in 0.498s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3e893e78-0950-4b97-a0a5-eaaed17a6700 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:25 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.info Apr 07 06:12:25 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:25 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3e893e78-0950-4b97-a0a5-eaaed17a6700 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.info" returned: 0 in 0.477s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:25 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-3e893e78-0950-4b97-a0a5-eaaed17a6700 tempest-CreateVolumesFromSnapshotTest-471045403 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.info is being set with open permissions: ugo+rw Apr 07 06:12:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3e893e78-0950-4b97-a0a5-eaaed17a6700 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:25 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.info Apr 07 06:12:25 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:26 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3e893e78-0950-4b97-a0a5-eaaed17a6700 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.info" returned: 0 in 0.504s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3e893e78-0950-4b97-a0a5-eaaed17a6700 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.199s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.405s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-9100859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfe5a4a-257d-4f37-a763-985c8744bfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056dc663fbc246cb81fe7ef44d880d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:23Z,use_quota=True,user_id='d7726e11612e41b9918305f81a17604a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Creating volume 1bfe5a4a-257d-4f37-a763-985c8744bfee {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:26 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1bfe5a4a-257d-4f37-a763-985c8744bfee 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:26 devstack sudo[87926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1bfe5a4a-257d-4f37-a763-985c8744bfee 1073741824 Apr 07 06:12:26 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:26 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-3e893e78-0950-4b97-a0a5-eaaed17a6700 tempest-CreateVolumesFromSnapshotTest-471045403 None] Create snapshot completed successfully Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Flow 'volume_create_manager' (c2e2e7c4-1889-4807-a309-4cace7a95a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c0c7c3-6845-4f40-883d-3ce018725a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c0c7c3-6845-4f40-883d-3ce018725a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-279017443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f193b638-f587-4d9a-b71b-24917128b55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202469865de44f2ca67d59c7d170f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:26Z,use_quota=True,user_id='95eea4452915475fb0af2018360f0ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd02b1e-b5ae-4d2e-8d42-0c8204544c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd02b1e-b5ae-4d2e-8d42-0c8204544c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c286ec5-f65b-495a-be01-c57b307100b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c286ec5-f65b-495a-be01-c57b307100b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f193b638-f587-4d9a-b71b-24917128b55e', 'volume_name': 'volume-f193b638-f587-4d9a-b71b-24917128b55e', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d280d0-6283-472c-b288-2f14b3b34cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:26 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d280d0-6283-472c-b288-2f14b3b34cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0498bebb-9933-4156-8c80-ec1f3fe0a2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:26 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Volume f193b638-f587-4d9a-b71b-24917128b55e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f193b638-f587-4d9a-b71b-24917128b55e', 'volume_size': 1} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1bfe5a4a-257d-4f37-a763-985c8744bfee 1073741824" returned: 0 in 0.600s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1bfe5a4a-257d-4f37-a763-985c8744bfee {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:26 devstack sudo[87931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1bfe5a4a-257d-4f37-a763-985c8744bfee Apr 07 06:12:26 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Flow 'volume_create_manager' (7151c267-ee51-4d34-996b-ea95ccfb9139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d0959e-8129-4d8a-bca4-cbb488ae57d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d0959e-8129-4d8a-bca4-cbb488ae57d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-184040435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6637fdc2-7b89-4ca8-aef8-a6160e144a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202469865de44f2ca67d59c7d170f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:27Z,use_quota=True,user_id='95eea4452915475fb0af2018360f0ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9baa0d27-6807-42e2-8be2-6c4afc20c6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9baa0d27-6807-42e2-8be2-6c4afc20c6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a5db46-beb6-46d4-952c-09a4440b41c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a5db46-beb6-46d4-952c-09a4440b41c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6637fdc2-7b89-4ca8-aef8-a6160e144a02', 'volume_name': 'volume-6637fdc2-7b89-4ca8-aef8-a6160e144a02', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f44a40-651a-4698-a63e-91d04bc4b897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f44a40-651a-4698-a63e-91d04bc4b897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925b0f2b-75d9-4ab4-a058-7335a50d70ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:26 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Volume 6637fdc2-7b89-4ca8-aef8-a6160e144a02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6637fdc2-7b89-4ca8-aef8-a6160e144a02', 'volume_size': 1} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Flow 'volume_create_manager' (ae77a2a8-993a-427a-85b3-fae0a92daadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9f3302-c2bd-41e1-acb8-308a36188258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9f3302-c2bd-41e1-acb8-308a36188258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-918461231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=290f0ab6-9a0f-4eae-8a6c-ce9c0769130b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7816f2a9bddc49e594c9f7c58f22c5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:27Z,use_quota=True,user_id='8996444800db4cd2a58a9ed8a0de0ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c1c76a-5329-42cc-b1e5-956939641fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c1c76a-5329-42cc-b1e5-956939641fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62ebeee-21de-4dc8-8ebe-2ad96f22f9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62ebeee-21de-4dc8-8ebe-2ad96f22f9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '290f0ab6-9a0f-4eae-8a6c-ce9c0769130b', 'volume_name': 'volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa187c2-2186-4e7b-8cae-f92bd27b9b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa187c2-2186-4e7b-8cae-f92bd27b9b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d4e167-8a10-4cd9-8578-48d206557416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Volume 290f0ab6-9a0f-4eae-8a6c-ce9c0769130b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b', 'volume_size': 1} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Flow 'volume_create_manager' (bdf335e4-1b3f-40f8-9ba7-46553cae63a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef672cb-67ef-4dfe-99fa-1f955585ff07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef672cb-67ef-4dfe-99fa-1f955585ff07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1825523793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a1b304-c8fb-4d74-83bb-2644b159389c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202469865de44f2ca67d59c7d170f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:27Z,use_quota=True,user_id='95eea4452915475fb0af2018360f0ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb1ba8f-f3f8-4bd1-8f6a-a08eb02427e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb1ba8f-f3f8-4bd1-8f6a-a08eb02427e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ef93e6-b977-4e3c-b769-e3c75ad1e50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ef93e6-b977-4e3c-b769-e3c75ad1e50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1a1b304-c8fb-4d74-83bb-2644b159389c', 'volume_name': 'volume-e1a1b304-c8fb-4d74-83bb-2644b159389c', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dea548c-60c6-4cda-b233-28babf942d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dea548c-60c6-4cda-b233-28babf942d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f82ae9f-8b9c-4308-9a92-77dc55efe440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Volume e1a1b304-c8fb-4d74-83bb-2644b159389c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1a1b304-c8fb-4d74-83bb-2644b159389c', 'volume_size': 1} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:27 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1bfe5a4a-257d-4f37-a763-985c8744bfee" returned: 0 in 0.558s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-be7aea4d-a486-4b78-af7c-20aca978a6cd tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.223s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de5a5d9-331d-4906-93cf-9c6278a7add0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bfe5a4a-257d-4f37-a763-985c8744bfee', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d74ad1d-6755-4972-8a44-09931daaa88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Flow 'volume_create_manager' (a1e22565-8e14-40a1-ae3c-3c416a58780c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8419e9a2-e48c-416c-8fae-f8db16bf7e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Volume volume-1bfe5a4a-257d-4f37-a763-985c8744bfee (1bfe5a4a-257d-4f37-a763-985c8744bfee): created successfully Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d74ad1d-6755-4972-8a44-09931daaa88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Flow 'volume_create_manager' (7cde14b8-ad47-4dea-a691-4d722f7504e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:27 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-89988d53-d018-457b-9a78-9756e5464c4a tempest-VolumesActionsTest-1898711442 None] Created volume successfully. Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-be7aea4d-a486-4b78-af7c-20aca978a6cd tempest-VolumesSnapshotListTestJSON-303684822 None] Creating offline snapshot d12a2509-765b-448a-88dd-517eb1f052a6 of volume 52378b05-8b9a-413b-b6ec-0ac59bbdbaab {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8419e9a2-e48c-416c-8fae-f8db16bf7e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-453752192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aed77e9-6a1d-4104-acf7-ce196826adf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202469865de44f2ca67d59c7d170f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:27Z,use_quota=True,user_id='95eea4452915475fb0af2018360f0ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3db101-09ab-4d6b-ad4f-077d6e52e57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3db101-09ab-4d6b-ad4f-077d6e52e57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02cbe0ea-2d4f-4f58-85d9-022ab6a27c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02cbe0ea-2d4f-4f58-85d9-022ab6a27c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aed77e9-6a1d-4104-acf7-ce196826adf8', 'volume_name': 'volume-5aed77e9-6a1d-4104-acf7-ce196826adf8', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ad83c7-4cbc-4a15-bb51-debb71535da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ad83c7-4cbc-4a15-bb51-debb71535da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be4ea83-9d40-4b48-a7ab-b0aac7f1ea53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Volume 5aed77e9-6a1d-4104-acf7-ce196826adf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aed77e9-6a1d-4104-acf7-ce196826adf8', 'volume_size': 1} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2fe023-4601-4457-b5b5-5f61b5faa3d6]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-be7aea4d-a486-4b78-af7c-20aca978a6cd tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:27 devstack sudo[87935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab Apr 07 06:12:27 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Flow 'volume_create_manager' (9e312cf3-7d0f-4750-acc7-f832def40d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7dfbce-2e11-4c3a-9e75-25c4768b186f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7dfbce-2e11-4c3a-9e75-25c4768b186f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-973018315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202469865de44f2ca67d59c7d170f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:27Z,use_quota=True,user_id='95eea4452915475fb0af2018360f0ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31f47ea-5885-432a-a8a2-09a361a65ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31f47ea-5885-432a-a8a2-09a361a65ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610f438d-adc0-4ff9-86d5-d8cc64d5ecde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610f438d-adc0-4ff9-86d5-d8cc64d5ecde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7', 'volume_name': 'volume-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4231e073-a9b0-4ea5-a360-f42717ea5c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4231e073-a9b0-4ea5-a360-f42717ea5c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25211d1-de73-4bd5-b947-31b88b5eee67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:27 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Volume da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7', 'volume_size': 1} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:27 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-be7aea4d-a486-4b78-af7c-20aca978a6cd tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab" returned: 0 in 0.467s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-be7aea4d-a486-4b78-af7c-20aca978a6cd tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:27 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 1G Apr 07 06:12:27 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:28 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] Acquiring lock "cinder-1bfe5a4a-257d-4f37-a763-985c8744bfee-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:28 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] Lock "cinder-1bfe5a4a-257d-4f37-a763-985c8744bfee-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:28 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] Acquiring lock "cinder-quobyte-1bfe5a4a-257d-4f37-a763-985c8744bfee" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:28 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] Lock "cinder-quobyte-1bfe5a4a-257d-4f37-a763-985c8744bfee" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:28 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4c932c-3602-4152-97da-f80dbcb3d704]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1bfe5a4a-257d-4f37-a763-985c8744bfee {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:28 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1bfe5a4a-257d-4f37-a763-985c8744bfee Apr 07 06:12:28 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:28 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-be7aea4d-a486-4b78-af7c-20aca978a6cd tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 1G" returned: 0 in 0.551s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-be7aea4d-a486-4b78-af7c-20aca978a6cd tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:28 devstack sudo[87947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 Apr 07 06:12:28 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:28 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1bfe5a4a-257d-4f37-a763-985c8744bfee" returned: 0 in 0.532s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1bfe5a4a-257d-4f37-a763-985c8744bfee {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:28 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1bfe5a4a-257d-4f37-a763-985c8744bfee Apr 07 06:12:28 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:28 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-be7aea4d-a486-4b78-af7c-20aca978a6cd tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6" returned: 0 in 0.465s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:28 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-be7aea4d-a486-4b78-af7c-20aca978a6cd tempest-VolumesSnapshotListTestJSON-303684822 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 is being set with open permissions: ugo+rw Apr 07 06:12:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-be7aea4d-a486-4b78-af7c-20aca978a6cd tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:28 devstack sudo[87957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 Apr 07 06:12:28 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:29 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1bfe5a4a-257d-4f37-a763-985c8744bfee" returned: 0 in 0.466s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:29 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] Lock "cinder-quobyte-1bfe5a4a-257d-4f37-a763-985c8744bfee" released by "delete_volume" :: held 1.032s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:29 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] Created reservations ['4d245199-7b02-4b3a-b9cd-3979934f643d', 'cdfb632a-c385-4ed1-b429-c941e0176474', '1ee91007-f691-4f69-8385-17b62ec2588e', '0f282015-0a70-4e4c-8d20-defc231c143b'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:29 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-be7aea4d-a486-4b78-af7c-20aca978a6cd tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6" returned: 0 in 0.449s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-be7aea4d-a486-4b78-af7c-20aca978a6cd tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:29 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:29 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:29 devstack sudo[87961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.info Apr 07 06:12:29 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:29 devstack sudo[87963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:29 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:29 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-be7aea4d-a486-4b78-af7c-20aca978a6cd tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.info" returned: 0 in 0.483s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:29 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-be7aea4d-a486-4b78-af7c-20aca978a6cd tempest-VolumesSnapshotListTestJSON-303684822 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.info is being set with open permissions: ugo+rw Apr 07 06:12:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-be7aea4d-a486-4b78-af7c-20aca978a6cd tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:29 devstack sudo[87968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.info Apr 07 06:12:29 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:29 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.479s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:29 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:29 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] Deleted volume successfully. Apr 07 06:12:29 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-769bede1-552b-474c-9f59-45454a30809a tempest-VolumesActionsTest-860442081 None] Lock "cinder-1bfe5a4a-257d-4f37-a763-985c8744bfee-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:30 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-be7aea4d-a486-4b78-af7c-20aca978a6cd tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.info" returned: 0 in 0.444s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-be7aea4d-a486-4b78-af7c-20aca978a6cd tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.018s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.606s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-279017443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f193b638-f587-4d9a-b71b-24917128b55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202469865de44f2ca67d59c7d170f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:26Z,use_quota=True,user_id='95eea4452915475fb0af2018360f0ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Creating volume f193b638-f587-4d9a-b71b-24917128b55e {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:30 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f193b638-f587-4d9a-b71b-24917128b55e 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:30 devstack sudo[87971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f193b638-f587-4d9a-b71b-24917128b55e 1073741824 Apr 07 06:12:30 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:30 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-be7aea4d-a486-4b78-af7c-20aca978a6cd tempest-VolumesSnapshotListTestJSON-303684822 None] Create snapshot completed successfully Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Flow 'volume_create_manager' (f09cfe14-6cb2-4833-8ba4-b023a379d20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3fcce3b-8da0-470b-9d0f-a4e816f23d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3fcce3b-8da0-470b-9d0f-a4e816f23d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1352145263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9873c468-d378-44a0-8bbb-aa891f7b8b3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056dc663fbc246cb81fe7ef44d880d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:31Z,use_quota=True,user_id='d7726e11612e41b9918305f81a17604a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd5e460-3c0b-49d9-9681-88ef8c80e381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd5e460-3c0b-49d9-9681-88ef8c80e381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6ffcad-325e-4644-9d24-778b6e95abf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6ffcad-325e-4644-9d24-778b6e95abf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9873c468-d378-44a0-8bbb-aa891f7b8b3f', 'volume_name': 'volume-9873c468-d378-44a0-8bbb-aa891f7b8b3f', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d803037-413c-4eed-9eee-7465a9fa64e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d803037-413c-4eed-9eee-7465a9fa64e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef87692-eaa8-435d-a3e4-3c707c8d4f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:30 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Volume 9873c468-d378-44a0-8bbb-aa891f7b8b3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9873c468-d378-44a0-8bbb-aa891f7b8b3f', 'volume_size': 1} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:30 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f193b638-f587-4d9a-b71b-24917128b55e 1073741824" returned: 0 in 0.563s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f193b638-f587-4d9a-b71b-24917128b55e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:30 devstack sudo[87976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f193b638-f587-4d9a-b71b-24917128b55e Apr 07 06:12:30 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:31 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f193b638-f587-4d9a-b71b-24917128b55e" returned: 0 in 0.467s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.483s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-184040435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6637fdc2-7b89-4ca8-aef8-a6160e144a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202469865de44f2ca67d59c7d170f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:27Z,use_quota=True,user_id='95eea4452915475fb0af2018360f0ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Creating volume 6637fdc2-7b89-4ca8-aef8-a6160e144a02 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:31 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6637fdc2-7b89-4ca8-aef8-a6160e144a02 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:31 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6637fdc2-7b89-4ca8-aef8-a6160e144a02 1073741824 Apr 07 06:12:31 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0498bebb-9933-4156-8c80-ec1f3fe0a2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f193b638-f587-4d9a-b71b-24917128b55e', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d297f35-69a8-4021-8dcd-03688f81a324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:31 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Volume volume-f193b638-f587-4d9a-b71b-24917128b55e (f193b638-f587-4d9a-b71b-24917128b55e): created successfully Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d297f35-69a8-4021-8dcd-03688f81a324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Flow 'volume_create_manager' (c2e2e7c4-1889-4807-a309-4cace7a95a78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-cae684a3-ed20-44cb-adf7-cdbb416ff744 tempest-VolumesSnapshotListTestJSON-303684822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:31 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-b7e53b9e-7325-421d-9015-f0bc8de2e290 tempest-CreateVolumesFromSnapshotTest-471045403 None] Created volume successfully. Apr 07 06:12:31 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6637fdc2-7b89-4ca8-aef8-a6160e144a02 1073741824" returned: 0 in 0.548s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6637fdc2-7b89-4ca8-aef8-a6160e144a02 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:31 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6637fdc2-7b89-4ca8-aef8-a6160e144a02 Apr 07 06:12:31 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:32 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6637fdc2-7b89-4ca8-aef8-a6160e144a02" returned: 0 in 0.435s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.273s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-918461231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=290f0ab6-9a0f-4eae-8a6c-ce9c0769130b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7816f2a9bddc49e594c9f7c58f22c5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:27Z,use_quota=True,user_id='8996444800db4cd2a58a9ed8a0de0ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Creating volume 290f0ab6-9a0f-4eae-8a6c-ce9c0769130b {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:32 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:12:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925b0f2b-75d9-4ab4-a058-7335a50d70ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6637fdc2-7b89-4ca8-aef8-a6160e144a02', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:32 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b 1073741824 Apr 07 06:12:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5840668e-3e48-4722-9e55-f018d613f058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:32 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:32 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Volume volume-6637fdc2-7b89-4ca8-aef8-a6160e144a02 (6637fdc2-7b89-4ca8-aef8-a6160e144a02): created successfully Apr 07 06:12:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5840668e-3e48-4722-9e55-f018d613f058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Flow 'volume_create_manager' (7151c267-ee51-4d34-996b-ea95ccfb9139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:32 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-e7c52ae4-ed3a-439f-b614-b9668f51d851 tempest-CreateVolumesFromSnapshotTest-471045403 None] Created volume successfully. Apr 07 06:12:32 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b 1073741824" returned: 0 in 0.532s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:32 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b Apr 07 06:12:32 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:33 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b" returned: 0 in 0.404s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:33 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.157s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:33 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1825523793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a1b304-c8fb-4d74-83bb-2644b159389c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202469865de44f2ca67d59c7d170f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:27Z,use_quota=True,user_id='95eea4452915475fb0af2018360f0ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:33 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Creating volume e1a1b304-c8fb-4d74-83bb-2644b159389c {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:33 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:33 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:33 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:33 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:12:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1a1b304-c8fb-4d74-83bb-2644b159389c 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:33 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d4e167-8a10-4cd9-8578-48d206557416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:33 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1a1b304-c8fb-4d74-83bb-2644b159389c 1073741824 Apr 07 06:12:33 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:33 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d59e05f-41e9-4310-89bb-c970ee764b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:33 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Volume volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b (290f0ab6-9a0f-4eae-8a6c-ce9c0769130b): created successfully Apr 07 06:12:33 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d59e05f-41e9-4310-89bb-c970ee764b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:33 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Flow 'volume_create_manager' (ae77a2a8-993a-427a-85b3-fae0a92daadd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:33 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-ced8e1eb-f792-4c8c-8c03-b728a2dcf43b tempest-VolumesDeleteCascade-1794776792 None] Created volume successfully. Apr 07 06:12:33 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1a1b304-c8fb-4d74-83bb-2644b159389c 1073741824" returned: 0 in 0.481s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1a1b304-c8fb-4d74-83bb-2644b159389c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:33 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1a1b304-c8fb-4d74-83bb-2644b159389c Apr 07 06:12:33 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:34 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1a1b304-c8fb-4d74-83bb-2644b159389c" returned: 0 in 0.388s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.896s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-453752192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aed77e9-6a1d-4104-acf7-ce196826adf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202469865de44f2ca67d59c7d170f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:27Z,use_quota=True,user_id='95eea4452915475fb0af2018360f0ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Creating volume 5aed77e9-6a1d-4104-acf7-ce196826adf8 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:34 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5aed77e9-6a1d-4104-acf7-ce196826adf8 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f82ae9f-8b9c-4308-9a92-77dc55efe440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a1b304-c8fb-4d74-83bb-2644b159389c', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a8fcbe-8aaf-4180-9e30-bb4db795ad59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:34 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5aed77e9-6a1d-4104-acf7-ce196826adf8 1073741824 Apr 07 06:12:34 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:34 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Volume volume-e1a1b304-c8fb-4d74-83bb-2644b159389c (e1a1b304-c8fb-4d74-83bb-2644b159389c): created successfully Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a8fcbe-8aaf-4180-9e30-bb4db795ad59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Flow 'volume_create_manager' (bdf335e4-1b3f-40f8-9ba7-46553cae63a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:34 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-9e18b2dc-1abd-4766-a378-6c96cc181058 tempest-CreateVolumesFromSnapshotTest-471045403 None] Created volume successfully. Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-09e56de2-3f81-499b-b425-1c119bf80bd7 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:34 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5aed77e9-6a1d-4104-acf7-ce196826adf8 1073741824" returned: 0 in 0.497s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5aed77e9-6a1d-4104-acf7-ce196826adf8 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:34 devstack sudo[88008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5aed77e9-6a1d-4104-acf7-ce196826adf8 Apr 07 06:12:34 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:35 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5aed77e9-6a1d-4104-acf7-ce196826adf8" returned: 0 in 0.384s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.609s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-973018315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202469865de44f2ca67d59c7d170f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:27Z,use_quota=True,user_id='95eea4452915475fb0af2018360f0ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Creating volume da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:35 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:12:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be4ea83-9d40-4b48-a7ab-b0aac7f1ea53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aed77e9-6a1d-4104-acf7-ce196826adf8', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:35 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7 1073741824 Apr 07 06:12:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c3a29c-8196-4625-9a66-0badf850048e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:35 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:35 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Volume volume-5aed77e9-6a1d-4104-acf7-ce196826adf8 (5aed77e9-6a1d-4104-acf7-ce196826adf8): created successfully Apr 07 06:12:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c3a29c-8196-4625-9a66-0badf850048e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:35 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Flow 'volume_create_manager' (a1e22565-8e14-40a1-ae3c-3c416a58780c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:35 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-b69ff6af-75a4-478c-93e6-a3ec163697df tempest-CreateVolumesFromSnapshotTest-471045403 None] Created volume successfully. Apr 07 06:12:35 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7 1073741824" returned: 0 in 0.480s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:35 devstack sudo[88016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7 Apr 07 06:12:35 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:36 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7" returned: 0 in 0.393s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.304s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1352145263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9873c468-d378-44a0-8bbb-aa891f7b8b3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056dc663fbc246cb81fe7ef44d880d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:31Z,use_quota=True,user_id='d7726e11612e41b9918305f81a17604a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Creating volume 9873c468-d378-44a0-8bbb-aa891f7b8b3f {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:36 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9873c468-d378-44a0-8bbb-aa891f7b8b3f 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25211d1-de73-4bd5-b947-31b88b5eee67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:36 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9873c468-d378-44a0-8bbb-aa891f7b8b3f 1073741824 Apr 07 06:12:36 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935d1f31-bd6c-4943-87cc-a82fb5b79a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:36 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Volume volume-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7 (da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7): created successfully Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935d1f31-bd6c-4943-87cc-a82fb5b79a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Flow 'volume_create_manager' (9e312cf3-7d0f-4750-acc7-f832def40d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:36 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-ecae9a44-b493-4f6e-af26-11314f80bf1e tempest-CreateVolumesFromSnapshotTest-471045403 None] Created volume successfully. Apr 07 06:12:36 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9873c468-d378-44a0-8bbb-aa891f7b8b3f 1073741824" returned: 0 in 0.473s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9873c468-d378-44a0-8bbb-aa891f7b8b3f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:36 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9873c468-d378-44a0-8bbb-aa891f7b8b3f Apr 07 06:12:36 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:36 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9873c468-d378-44a0-8bbb-aa891f7b8b3f" returned: 0 in 0.397s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-cae684a3-ed20-44cb-adf7-cdbb416ff744 tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.568s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef87692-eaa8-435d-a3e4-3c707c8d4f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9873c468-d378-44a0-8bbb-aa891f7b8b3f', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd3fed8d-e171-4226-b19f-4d65838113ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-cae684a3-ed20-44cb-adf7-cdbb416ff744 tempest-VolumesSnapshotListTestJSON-303684822 None] Creating offline snapshot 751dd16e-0c36-44a3-8ba9-6a4db05db197 of volume 52378b05-8b9a-413b-b6ec-0ac59bbdbaab {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:12:36 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Volume volume-9873c468-d378-44a0-8bbb-aa891f7b8b3f (9873c468-d378-44a0-8bbb-aa891f7b8b3f): created successfully Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd3fed8d-e171-4226-b19f-4d65838113ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Flow 'volume_create_manager' (f09cfe14-6cb2-4833-8ba4-b023a379d20e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a0eff9-780f-40a2-a5cd-6abb103af110]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cae684a3-ed20-44cb-adf7-cdbb416ff744 tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:37 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-1d9c5605-2313-4cae-9616-387f5d51afc8 tempest-VolumesActionsTest-1898711442 None] Created volume successfully. Apr 07 06:12:37 devstack sudo[88027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 Apr 07 06:12:37 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:37 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "cinder-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:37 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:37 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "cinder-quobyte-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:37 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-quobyte-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:37 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc395d1-5838-4685-ae3f-2fbf1e81c79c]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:37 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7 Apr 07 06:12:37 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:37 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cae684a3-ed20-44cb-adf7-cdbb416ff744 tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6" returned: 0 in 0.519s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:37 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-cae684a3-ed20-44cb-adf7-cdbb416ff744 tempest-VolumesSnapshotListTestJSON-303684822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:12:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cae684a3-ed20-44cb-adf7-cdbb416ff744 tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:37 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 1G Apr 07 06:12:37 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:37 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7" returned: 0 in 0.533s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:37 devstack sudo[88039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7 Apr 07 06:12:37 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:38 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cae684a3-ed20-44cb-adf7-cdbb416ff744 tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 1G" returned: 0 in 0.575s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cae684a3-ed20-44cb-adf7-cdbb416ff744 tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:38 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 Apr 07 06:12:38 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] Acquiring lock "cinder-9873c468-d378-44a0-8bbb-aa891f7b8b3f-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] Lock "cinder-9873c468-d378-44a0-8bbb-aa891f7b8b3f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] Acquiring lock "cinder-quobyte-9873c468-d378-44a0-8bbb-aa891f7b8b3f" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] Lock "cinder-quobyte-9873c468-d378-44a0-8bbb-aa891f7b8b3f" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b14797-18a8-44e0-b3da-3b669d8b8244]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9873c468-d378-44a0-8bbb-aa891f7b8b3f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:38 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7" returned: 0 in 0.467s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-quobyte-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7" released by "delete_volume" :: held 1.039s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:38 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9873c468-d378-44a0-8bbb-aa891f7b8b3f Apr 07 06:12:38 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] Created reservations ['414fa308-7680-4996-8ac8-f6b88efc7ff2', 'c4044891-bd47-495e-8195-23723b874cc7', '9a99a586-4c8d-43ef-859c-0f7daebef3d5', 'd022a709-af7f-4e83-b715-ce0face5660b'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:38 devstack sudo[88049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:38 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:38 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cae684a3-ed20-44cb-adf7-cdbb416ff744 tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197" returned: 0 in 0.510s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:38 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-cae684a3-ed20-44cb-adf7-cdbb416ff744 tempest-VolumesSnapshotListTestJSON-303684822 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 is being set with open permissions: ugo+rw Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cae684a3-ed20-44cb-adf7-cdbb416ff744 tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:38 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 Apr 07 06:12:38 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:38 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9873c468-d378-44a0-8bbb-aa891f7b8b3f" returned: 0 in 0.531s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9873c468-d378-44a0-8bbb-aa891f7b8b3f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:38 devstack sudo[88060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9873c468-d378-44a0-8bbb-aa891f7b8b3f Apr 07 06:12:38 devstack sudo[88060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:38 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.474s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:38 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] Deleted volume successfully. Apr 07 06:12:38 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-612197d3-9b46-4f9c-bb12-e026bc587fde tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-da8ad675-7fe4-41d6-b9e8-9e69ddd14ee7-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:39 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-cae684a3-ed20-44cb-adf7-cdbb416ff744 tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197" returned: 0 in 0.449s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-cae684a3-ed20-44cb-adf7-cdbb416ff744 tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.127s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-09e56de2-3f81-499b-b425-1c119bf80bd7 tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.644s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-09e56de2-3f81-499b-b425-1c119bf80bd7 tempest-VolumesDeleteCascade-1794776792 None] Creating offline snapshot 4084de92-8fb0-4585-8390-4218279572e1 of volume 290f0ab6-9a0f-4eae-8a6c-ce9c0769130b {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:12:39 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-cae684a3-ed20-44cb-adf7-cdbb416ff744 tempest-VolumesSnapshotListTestJSON-303684822 None] Create snapshot completed successfully Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[d740cf14-b419-498d-8bdc-97457ce172e3]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e56de2-3f81-499b-b425-1c119bf80bd7 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:39 devstack sudo[88063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b Apr 07 06:12:39 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:39 devstack sudo[88060]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9873c468-d378-44a0-8bbb-aa891f7b8b3f" returned: 0 in 0.451s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] Lock "cinder-quobyte-9873c468-d378-44a0-8bbb-aa891f7b8b3f" released by "delete_volume" :: held 1.005s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] Created reservations ['65e86b01-deae-4d4e-9c0c-a9c3ec7a6d43', 'd32ce8d1-c114-4ede-b056-b73416b93304', '1b76bc0b-97e0-41c1-bffb-b986a4c0b264', 'e063256f-3465-4a56-845e-566617c23daa'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:39 devstack sudo[88066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:39 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "cinder-5aed77e9-6a1d-4104-acf7-ce196826adf8-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-5aed77e9-6a1d-4104-acf7-ce196826adf8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "cinder-quobyte-5aed77e9-6a1d-4104-acf7-ce196826adf8" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-quobyte-5aed77e9-6a1d-4104-acf7-ce196826adf8" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4402c2-3523-4764-9993-1fe663d7c7d4]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5aed77e9-6a1d-4104-acf7-ce196826adf8 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:39 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5aed77e9-6a1d-4104-acf7-ce196826adf8 Apr 07 06:12:39 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:39 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e56de2-3f81-499b-b425-1c119bf80bd7 tempest-VolumesDeleteCascade-1794776792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b" returned: 0 in 0.528s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e56de2-3f81-499b-b425-1c119bf80bd7 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:39 devstack sudo[88073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 1G Apr 07 06:12:39 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e0c140c6-02a1-4785-83aa-758dede63a4f tempest-VolumesSnapshotListTestJSON-303684822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:39 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.673s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:39 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:39 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] Deleted volume successfully. Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-83e92c23-acca-47a9-9745-9cfbf93d5ae0 tempest-VolumesActionsTest-860442081 None] Lock "cinder-9873c468-d378-44a0-8bbb-aa891f7b8b3f-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:40 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5aed77e9-6a1d-4104-acf7-ce196826adf8" returned: 0 in 0.598s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5aed77e9-6a1d-4104-acf7-ce196826adf8 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:40 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5aed77e9-6a1d-4104-acf7-ce196826adf8 Apr 07 06:12:40 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:40 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e56de2-3f81-499b-b425-1c119bf80bd7 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 1G" returned: 0 in 0.599s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e56de2-3f81-499b-b425-1c119bf80bd7 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:40 devstack sudo[88085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 Apr 07 06:12:40 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:40 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-5aed77e9-6a1d-4104-acf7-ce196826adf8" returned: 0 in 0.521s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-quobyte-5aed77e9-6a1d-4104-acf7-ce196826adf8" released by "delete_volume" :: held 1.146s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] Created reservations ['9b60b570-7a49-4a3d-a054-e07a9540ba66', '8adfe33d-8f9a-4714-ba80-3a864cfdeab5', 'e5394fc6-0c2d-4f74-99d9-d85a9676ea90', '231e1454-9158-49c5-80b4-cdb354b07915'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:40 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Flow 'volume_create_manager' (4f1d1ffc-657d-41f5-8773-8c87d51a3aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462eee5c-0622-4e9e-a33e-9090c1a044cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e56de2-3f81-499b-b425-1c119bf80bd7 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1" returned: 0 in 0.567s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:40 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-09e56de2-3f81-499b-b425-1c119bf80bd7 tempest-VolumesDeleteCascade-1794776792 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 is being set with open permissions: ugo+rw Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e56de2-3f81-499b-b425-1c119bf80bd7 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462eee5c-0622-4e9e-a33e-9090c1a044cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1547445456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=774e4788-08f4-4022-88de-a395726affc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056dc663fbc246cb81fe7ef44d880d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:41Z,use_quota=True,user_id='d7726e11612e41b9918305f81a17604a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c99f88f-0418-4782-99ca-e36f33b4c54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:40 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 Apr 07 06:12:40 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c99f88f-0418-4782-99ca-e36f33b4c54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034d4400-38b8-459d-ad7b-1bb13216ea9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034d4400-38b8-459d-ad7b-1bb13216ea9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '774e4788-08f4-4022-88de-a395726affc3', 'volume_name': 'volume-774e4788-08f4-4022-88de-a395726affc3', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d26b71a-5010-4d07-805e-4332b9ef7f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d26b71a-5010-4d07-805e-4332b9ef7f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a9319d-1184-419d-b7b6-70006d56f16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:40 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Volume 774e4788-08f4-4022-88de-a395726affc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-774e4788-08f4-4022-88de-a395726affc3', 'volume_size': 1} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:40 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:40 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:41 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e56de2-3f81-499b-b425-1c119bf80bd7 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1" returned: 0 in 0.514s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:41 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.454s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:41 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:41 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] Deleted volume successfully. Apr 07 06:12:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e56de2-3f81-499b-b425-1c119bf80bd7 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-35c70364-d6fa-4bfc-9cab-80dac0bc7d59 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-5aed77e9-6a1d-4104-acf7-ce196826adf8-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:41 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.info Apr 07 06:12:41 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "cinder-e1a1b304-c8fb-4d74-83bb-2644b159389c-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-e1a1b304-c8fb-4d74-83bb-2644b159389c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "cinder-quobyte-e1a1b304-c8fb-4d74-83bb-2644b159389c" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-quobyte-e1a1b304-c8fb-4d74-83bb-2644b159389c" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:41 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e08a1a-9d42-4ac5-a948-3b5e8675412f]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1a1b304-c8fb-4d74-83bb-2644b159389c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:41 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1a1b304-c8fb-4d74-83bb-2644b159389c Apr 07 06:12:41 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:41 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e56de2-3f81-499b-b425-1c119bf80bd7 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.info" returned: 0 in 0.484s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:41 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-09e56de2-3f81-499b-b425-1c119bf80bd7 tempest-VolumesDeleteCascade-1794776792 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.info is being set with open permissions: ugo+rw Apr 07 06:12:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e56de2-3f81-499b-b425-1c119bf80bd7 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:41 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.info Apr 07 06:12:41 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:42 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1a1b304-c8fb-4d74-83bb-2644b159389c" returned: 0 in 0.489s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1a1b304-c8fb-4d74-83bb-2644b159389c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:42 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1a1b304-c8fb-4d74-83bb-2644b159389c Apr 07 06:12:42 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:42 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09e56de2-3f81-499b-b425-1c119bf80bd7 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.info" returned: 0 in 0.443s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-09e56de2-3f81-499b-b425-1c119bf80bd7 tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.218s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e0c140c6-02a1-4785-83aa-758dede63a4f tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.486s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-e0c140c6-02a1-4785-83aa-758dede63a4f tempest-VolumesSnapshotListTestJSON-303684822 None] Creating offline snapshot 6c160bd7-ea60-4cf0-9d1e-3795a5490625 of volume 52378b05-8b9a-413b-b6ec-0ac59bbdbaab {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:12:42 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-09e56de2-3f81-499b-b425-1c119bf80bd7 tempest-VolumesDeleteCascade-1794776792 None] Create snapshot completed successfully Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[03eb21f9-c699-41f1-951c-a9f1c39d2470]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e0c140c6-02a1-4785-83aa-758dede63a4f tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:42 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 Apr 07 06:12:42 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:42 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e1a1b304-c8fb-4d74-83bb-2644b159389c" returned: 0 in 0.446s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-quobyte-e1a1b304-c8fb-4d74-83bb-2644b159389c" released by "delete_volume" :: held 0.976s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] Created reservations ['50a3632e-9c0f-4383-a57b-6cd5ac3ca312', 'f213994c-e4cc-43ab-9b57-cd2fa8bbc41d', '24f1e003-031a-4e64-a465-34b3eeaa5bca', '7c74d5a7-8de2-43b6-8e71-c931894c1157'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:42 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:42 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "cinder-6637fdc2-7b89-4ca8-aef8-a6160e144a02-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-6637fdc2-7b89-4ca8-aef8-a6160e144a02-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "cinder-quobyte-6637fdc2-7b89-4ca8-aef8-a6160e144a02" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-quobyte-6637fdc2-7b89-4ca8-aef8-a6160e144a02" acquired by "delete_volume" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[f558d153-23de-4254-8192-418dfec5c25d]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6637fdc2-7b89-4ca8-aef8-a6160e144a02 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:42 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e0c140c6-02a1-4785-83aa-758dede63a4f tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197" returned: 0 in 0.551s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-e0c140c6-02a1-4785-83aa-758dede63a4f tempest-VolumesSnapshotListTestJSON-303684822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e0c140c6-02a1-4785-83aa-758dede63a4f tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7f278c66-09f1-43bc-89c2-06aa81207077 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:42 devstack sudo[88119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625 1G Apr 07 06:12:42 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:42 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6637fdc2-7b89-4ca8-aef8-a6160e144a02 Apr 07 06:12:43 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:43 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.549s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:43 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:43 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] Deleted volume successfully. Apr 07 06:12:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-7ac31707-ed93-407f-b423-5555e16931d1 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-e1a1b304-c8fb-4d74-83bb-2644b159389c-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:43 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6637fdc2-7b89-4ca8-aef8-a6160e144a02" returned: 0 in 0.573s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6637fdc2-7b89-4ca8-aef8-a6160e144a02 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:43 devstack sudo[88129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6637fdc2-7b89-4ca8-aef8-a6160e144a02 Apr 07 06:12:43 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:43 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e0c140c6-02a1-4785-83aa-758dede63a4f tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625 1G" returned: 0 in 0.601s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e0c140c6-02a1-4785-83aa-758dede63a4f tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:43 devstack sudo[88131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625 Apr 07 06:12:43 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:43 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6637fdc2-7b89-4ca8-aef8-a6160e144a02" returned: 0 in 0.442s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-quobyte-6637fdc2-7b89-4ca8-aef8-a6160e144a02" released by "delete_volume" :: held 1.058s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:43 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] Created reservations ['52d9ae6a-ff5e-436e-8bd9-87077fbe4b6c', '13948541-28de-483b-9035-6a9d6ad87399', '0c978ab8-8ed9-4349-a40f-7030ab330f2e', '475b2012-ed5f-4d54-a502-e74584dc399e'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:44 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e0c140c6-02a1-4785-83aa-758dede63a4f tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625" returned: 0 in 0.544s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:44 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-e0c140c6-02a1-4785-83aa-758dede63a4f tempest-VolumesSnapshotListTestJSON-303684822 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625 is being set with open permissions: ugo+rw Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e0c140c6-02a1-4785-83aa-758dede63a4f tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:44 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:44 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:44 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625 Apr 07 06:12:44 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:44 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.424s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:44 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e0c140c6-02a1-4785-83aa-758dede63a4f tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625" returned: 0 in 0.420s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:44 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] Deleted volume successfully. Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e0c140c6-02a1-4785-83aa-758dede63a4f tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.190s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.632s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1547445456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=774e4788-08f4-4022-88de-a395726affc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056dc663fbc246cb81fe7ef44d880d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:41Z,use_quota=True,user_id='d7726e11612e41b9918305f81a17604a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Creating volume 774e4788-08f4-4022-88de-a395726affc3 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:44 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-774e4788-08f4-4022-88de-a395726affc3 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:44 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-774e4788-08f4-4022-88de-a395726affc3 1073741824 Apr 07 06:12:44 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0290ed00-7281-4125-99be-9ef95857a98a tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-6637fdc2-7b89-4ca8-aef8-a6160e144a02-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:44 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-e0c140c6-02a1-4785-83aa-758dede63a4f tempest-VolumesSnapshotListTestJSON-303684822 None] Create snapshot completed successfully Apr 07 06:12:44 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-774e4788-08f4-4022-88de-a395726affc3 1073741824" returned: 0 in 0.465s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-774e4788-08f4-4022-88de-a395726affc3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:45 devstack sudo[88148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-774e4788-08f4-4022-88de-a395726affc3 Apr 07 06:12:45 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "cinder-f193b638-f587-4d9a-b71b-24917128b55e-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-f193b638-f587-4d9a-b71b-24917128b55e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "cinder-quobyte-f193b638-f587-4d9a-b71b-24917128b55e" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-quobyte-f193b638-f587-4d9a-b71b-24917128b55e" acquired by "delete_volume" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9d5bbb-dbde-4ef6-bbe9-f1674d98784d]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f193b638-f587-4d9a-b71b-24917128b55e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:45 devstack sudo[88150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f193b638-f587-4d9a-b71b-24917128b55e Apr 07 06:12:45 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:45 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-774e4788-08f4-4022-88de-a395726affc3" returned: 0 in 0.448s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7f278c66-09f1-43bc-89c2-06aa81207077 tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.506s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a9319d-1184-419d-b7b6-70006d56f16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-774e4788-08f4-4022-88de-a395726affc3', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e66402a-de14-405e-88eb-28d4f8948670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:45 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Volume volume-774e4788-08f4-4022-88de-a395726affc3 (774e4788-08f4-4022-88de-a395726affc3): created successfully Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e66402a-de14-405e-88eb-28d4f8948670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Flow 'volume_create_manager' (4f1d1ffc-657d-41f5-8773-8c87d51a3aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-7f278c66-09f1-43bc-89c2-06aa81207077 tempest-VolumesDeleteCascade-1794776792 None] Creating offline snapshot 68cc475b-5755-4361-a0d1-34c3932c3f4f of volume 290f0ab6-9a0f-4eae-8a6c-ce9c0769130b {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:12:45 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-02eb90af-e533-4fcd-9661-2a16a9902674 tempest-VolumesActionsTest-1898711442 None] Created volume successfully. Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c416c9-2030-4edd-86e1-e08380e5904a]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f278c66-09f1-43bc-89c2-06aa81207077 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:45 devstack sudo[88153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 Apr 07 06:12:45 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] Acquiring lock "cinder-6c160bd7-ea60-4cf0-9d1e-3795a5490625-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-6c160bd7-ea60-4cf0-9d1e-3795a5490625-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] Acquiring lock "cinder-quobyte-52378b05-8b9a-413b-b6ec-0ac59bbdbaab" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-quobyte-52378b05-8b9a-413b-b6ec-0ac59bbdbaab" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] Acquiring lock "cinder-quobyte-6c160bd7-ea60-4cf0-9d1e-3795a5490625" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:45 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-quobyte-6c160bd7-ea60-4cf0-9d1e-3795a5490625" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] Deleting offline snapshot 6c160bd7-ea60-4cf0-9d1e-3795a5490625 of volume 52378b05-8b9a-413b-b6ec-0ac59bbdbaab {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] snapshot_file for this snap is: volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f193b638-f587-4d9a-b71b-24917128b55e" returned: 0 in 0.582s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f193b638-f587-4d9a-b71b-24917128b55e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[679eefc3-3f67-4248-ab99-1395d7329f33]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:45 devstack sudo[88158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f193b638-f587-4d9a-b71b-24917128b55e Apr 07 06:12:45 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:45 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625 Apr 07 06:12:45 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:46 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f278c66-09f1-43bc-89c2-06aa81207077 tempest-VolumesDeleteCascade-1794776792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1" returned: 0 in 0.495s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-7f278c66-09f1-43bc-89c2-06aa81207077 tempest-VolumesDeleteCascade-1794776792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f278c66-09f1-43bc-89c2-06aa81207077 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:46 devstack sudo[88165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f 1G Apr 07 06:12:46 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:46 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-f193b638-f587-4d9a-b71b-24917128b55e" returned: 0 in 0.455s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-quobyte-f193b638-f587-4d9a-b71b-24917128b55e" released by "delete_volume" :: held 1.076s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] Acquiring lock "cinder-774e4788-08f4-4022-88de-a395726affc3-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] Lock "cinder-774e4788-08f4-4022-88de-a395726affc3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:46 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625" returned: 0 in 0.544s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] Acquiring lock "cinder-quobyte-774e4788-08f4-4022-88de-a395726affc3" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90d57d7-5854-48a1-a962-ca0899a7bc28]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] Created reservations ['97ff4584-3d0b-489c-9acf-f9897909ffcc', 'b1bfbd00-6e01-4467-ba5b-a3edebd98b2a', 'c935f597-341c-4a67-8d91-b3ad59bdbb1e', '9804d1e6-0d27-4604-b5df-f06e9d546923'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] Lock "cinder-quobyte-774e4788-08f4-4022-88de-a395726affc3" acquired by "delete_volume" :: waited 0.045s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2788646-8e0a-4f18-93ab-5ab200c1c556]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-774e4788-08f4-4022-88de-a395726affc3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:46 devstack sudo[88171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 Apr 07 06:12:46 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:46 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:46 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:46 devstack sudo[88172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-774e4788-08f4-4022-88de-a395726affc3 Apr 07 06:12:46 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:46 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f278c66-09f1-43bc-89c2-06aa81207077 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f 1G" returned: 0 in 0.599s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f278c66-09f1-43bc-89c2-06aa81207077 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:46 devstack sudo[88180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f Apr 07 06:12:46 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:46 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197" returned: 0 in 0.524s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:46 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625 Apr 07 06:12:46 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:46 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.488s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:46 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] Deleted volume successfully. Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5a5f8298-f553-4844-8e8c-2b98f95074c2 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-f193b638-f587-4d9a-b71b-24917128b55e-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:46 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-774e4788-08f4-4022-88de-a395726affc3" returned: 0 in 0.604s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-774e4788-08f4-4022-88de-a395726affc3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:46 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-774e4788-08f4-4022-88de-a395726affc3 Apr 07 06:12:46 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:47 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f278c66-09f1-43bc-89c2-06aa81207077 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f" returned: 0 in 0.465s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:47 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-7f278c66-09f1-43bc-89c2-06aa81207077 tempest-VolumesDeleteCascade-1794776792 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f is being set with open permissions: ugo+rw Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f278c66-09f1-43bc-89c2-06aa81207077 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:47 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f Apr 07 06:12:47 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:47 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:47 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-774e4788-08f4-4022-88de-a395726affc3" returned: 0 in 0.470s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] Lock "cinder-quobyte-774e4788-08f4-4022-88de-a395726affc3" released by "delete_volume" :: held 1.100s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625" returned: 0 in 0.608s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:47 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625 Apr 07 06:12:47 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] Created reservations ['9c789c9c-0544-4120-92e1-de9f265a76a3', '315efd23-1766-4518-a337-997627ca6b74', 'a2d01ce9-0108-41f7-a2e1-8543773723c2', '96dadf61-91d8-4692-9947-3df8ae604272'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:47 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "cinder-dad6618d-da9b-489f-be2e-775753f019e0-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f278c66-09f1-43bc-89c2-06aa81207077 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f" returned: 0 in 0.461s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7f278c66-09f1-43bc-89c2-06aa81207077 tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.139s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-dad6618d-da9b-489f-be2e-775753f019e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "cinder-quobyte-9fde5fd3-b983-493c-a3ee-107a3acc2bb0" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:47 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-7f278c66-09f1-43bc-89c2-06aa81207077 tempest-VolumesDeleteCascade-1794776792 None] Create snapshot completed successfully Apr 07 06:12:47 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:47 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-quobyte-9fde5fd3-b983-493c-a3ee-107a3acc2bb0" acquired by "delete_snapshot" :: waited 0.039s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "cinder-quobyte-dad6618d-da9b-489f-be2e-775753f019e0" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-quobyte-dad6618d-da9b-489f-be2e-775753f019e0" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] Deleting offline snapshot dad6618d-da9b-489f-be2e-775753f019e0 of volume 9fde5fd3-b983-493c-a3ee-107a3acc2bb0 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] snapshot_file for this snap is: volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[b515c6a9-35f5-48be-a991-4610dc0ab741]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:47 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0 Apr 07 06:12:47 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:47 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.6c160bd7-ea60-4cf0-9d1e-3795a5490625" returned: 0 in 0.457s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-quobyte-6c160bd7-ea60-4cf0-9d1e-3795a5490625" released by "_delete_snapshot" :: held 2.208s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-quobyte-52378b05-8b9a-413b-b6ec-0ac59bbdbaab" released by "delete_snapshot" :: held 2.221s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:47 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] Created reservations ['60ca1be8-5574-4fcc-9274-c5cfee3b2d99', 'be33cffe-b9ef-4949-8b2a-165b0f5dd230', '2cca7563-82ed-4160-94e0-faa9eb1a28d7', 'c62cc7b1-2fdf-4148-8e3f-4aa10636d84c'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:48 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] Delete snapshot completed successfully. Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-016483c9-3b08-4903-b572-ebcbbaf3efdb tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-6c160bd7-ea60-4cf0-9d1e-3795a5490625-delete_snapshot" released by "delete_snapshot" :: held 2.319s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:48 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.439s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:48 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] Deleted volume successfully. Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-7e35e2de-1a15-4319-9d81-6bb57ade47cc tempest-VolumesActionsTest-860442081 None] Lock "cinder-774e4788-08f4-4022-88de-a395726affc3-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:48 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0" returned: 0 in 0.507s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "cinder-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6a1d57-31ff-47e8-9095-bce7f78ca373]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Performing cascade delete. {{(pid=82475) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "cinder-4084de92-8fb0-4585-8390-4218279572e1-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-4084de92-8fb0-4585-8390-4218279572e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "cinder-quobyte-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "cinder-quobyte-4084de92-8fb0-4585-8390-4218279572e1" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-4084de92-8fb0-4585-8390-4218279572e1" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:48 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0 Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Deleting offline snapshot 4084de92-8fb0-4585-8390-4218279572e1 of volume 290f0ab6-9a0f-4eae-8a6c-ce9c0769130b {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:12:48 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] snapshot_file for this snap is: volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03660be-35f5-4842-84f8-81a20107b4dd]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:48 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 Apr 07 06:12:48 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:48 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Flow 'volume_create_manager' (4c6f645d-e599-4b2c-beab-5966eba2a146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9003fa-87d7-4808-b118-0109c3b50c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0" returned: 0 in 0.613s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9003fa-87d7-4808-b118-0109c3b50c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1826643260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f7a00b-4ee5-4820-abc4-c3e599312d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056dc663fbc246cb81fe7ef44d880d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:49Z,use_quota=True,user_id='d7726e11612e41b9918305f81a17604a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:48 devstack sudo[88224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0 Apr 07 06:12:48 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72109663-d076-44de-b37e-715926ca49ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72109663-d076-44de-b37e-715926ca49ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d56fde56-39fa-4da8-beb1-7f1713155b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d56fde56-39fa-4da8-beb1-7f1713155b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94f7a00b-4ee5-4820-abc4-c3e599312d77', 'volume_name': 'volume-94f7a00b-4ee5-4820-abc4-c3e599312d77', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f337828-5b96-4663-94da-c6b6997ff2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f337828-5b96-4663-94da-c6b6997ff2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc3d4e42-efda-4f25-a9f6-025120473603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:48 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Volume 94f7a00b-4ee5-4820-abc4-c3e599312d77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94f7a00b-4ee5-4820-abc4-c3e599312d77', 'volume_size': 1} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1826643260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f7a00b-4ee5-4820-abc4-c3e599312d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056dc663fbc246cb81fe7ef44d880d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:49Z,use_quota=True,user_id='d7726e11612e41b9918305f81a17604a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Creating volume 94f7a00b-4ee5-4820-abc4-c3e599312d77 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:48 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-94f7a00b-4ee5-4820-abc4-c3e599312d77 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] Acquiring lock "cinder-751dd16e-0c36-44a3-8ba9-6a4db05db197-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:48 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:48 devstack sudo[88226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-94f7a00b-4ee5-4820-abc4-c3e599312d77 1073741824 Apr 07 06:12:48 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1" returned: 0 in 0.618s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-751dd16e-0c36-44a3-8ba9-6a4db05db197-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] Acquiring lock "cinder-quobyte-52378b05-8b9a-413b-b6ec-0ac59bbdbaab" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc5eb17-181d-4524-a5b7-1716fce2d078]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-quobyte-52378b05-8b9a-413b-b6ec-0ac59bbdbaab" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] Acquiring lock "cinder-quobyte-751dd16e-0c36-44a3-8ba9-6a4db05db197" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-quobyte-751dd16e-0c36-44a3-8ba9-6a4db05db197" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] Deleting offline snapshot 751dd16e-0c36-44a3-8ba9-6a4db05db197 of volume 52378b05-8b9a-413b-b6ec-0ac59bbdbaab {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] snapshot_file for this snap is: volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d6af9d-e970-43e2-a4da-35bfa40040cc]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:49 devstack sudo[88228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b Apr 07 06:12:49 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:49 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 Apr 07 06:12:49 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:49 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0" returned: 0 in 0.526s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:49 devstack sudo[88241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0 Apr 07 06:12:49 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:49 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b" returned: 0 in 0.529s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:49 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f5184b-4691-4b15-a3cb-3dbc523abf52]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:49 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-94f7a00b-4ee5-4820-abc4-c3e599312d77 1073741824" returned: 0 in 0.643s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-94f7a00b-4ee5-4820-abc4-c3e599312d77 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:49 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-94f7a00b-4ee5-4820-abc4-c3e599312d77 Apr 07 06:12:49 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:49 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f Apr 07 06:12:49 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:49 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197" returned: 0 in 0.640s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:49 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:12:49 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e549fcd-26fa-4570-9da1-5465d832926c]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:49 devstack sudo[88250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 Apr 07 06:12:49 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:49 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0.dad6618d-da9b-489f-be2e-775753f019e0" returned: 0 in 0.499s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:49 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-quobyte-dad6618d-da9b-489f-be2e-775753f019e0" released by "_delete_snapshot" :: held 2.207s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:49 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-quobyte-9fde5fd3-b983-493c-a3ee-107a3acc2bb0" released by "delete_snapshot" :: held 2.222s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:49 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] Created reservations ['866baa40-8ff0-4ffe-b64c-d2625d4526e2', '69450ca0-9952-4ca7-b2dd-a1ff70049936', '3e4ef001-cb51-4298-9049-3ab29b4a3929', '69eac74b-2cd3-4b8c-a5f1-530550d13782'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:49 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] Delete snapshot completed successfully. Apr 07 06:12:49 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c04fb2e5-1be3-48d0-8e03-5fc20dab4da8 tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-dad6618d-da9b-489f-be2e-775753f019e0-delete_snapshot" released by "delete_snapshot" :: held 2.356s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:50 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-94f7a00b-4ee5-4820-abc4-c3e599312d77" returned: 0 in 0.499s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc3d4e42-efda-4f25-a9f6-025120473603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f7a00b-4ee5-4820-abc4-c3e599312d77', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f821a04-4848-45ea-973a-6fd3edb9dc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:50 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Volume volume-94f7a00b-4ee5-4820-abc4-c3e599312d77 (94f7a00b-4ee5-4820-abc4-c3e599312d77): created successfully Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f821a04-4848-45ea-973a-6fd3edb9dc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Flow 'volume_create_manager' (4c6f645d-e599-4b2c-beab-5966eba2a146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:50 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-c9330c45-0c03-476f-95a8-87a0b239f279 tempest-VolumesActionsTest-1898711442 None] Created volume successfully. Apr 07 06:12:50 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f" returned: 0 in 0.666s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb35cc4-af3e-4b22-a800-b58dbdd441e7]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:50 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6" returned: 0 in 0.561s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:50 devstack sudo[88262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 Apr 07 06:12:50 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:50 devstack sudo[88261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 Apr 07 06:12:50 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:50 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197" returned: 0 in 0.494s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:50 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197 Apr 07 06:12:50 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "cinder-9fde5fd3-b983-493c-a3ee-107a3acc2bb0-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-9fde5fd3-b983-493c-a3ee-107a3acc2bb0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:50 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1" returned: 0 in 0.603s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[44aeffbf-6fd4-4b96-aec7-8dfb37083b01]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "cinder-quobyte-9fde5fd3-b983-493c-a3ee-107a3acc2bb0" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-quobyte-9fde5fd3-b983-493c-a3ee-107a3acc2bb0" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3a886d-3032-4484-83b9-ed986192e46c]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:50 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b Apr 07 06:12:50 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:50 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0 Apr 07 06:12:50 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] Acquiring lock "cinder-94f7a00b-4ee5-4820-abc4-c3e599312d77-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] Lock "cinder-94f7a00b-4ee5-4820-abc4-c3e599312d77-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] Acquiring lock "cinder-quobyte-94f7a00b-4ee5-4820-abc4-c3e599312d77" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] Lock "cinder-quobyte-94f7a00b-4ee5-4820-abc4-c3e599312d77" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b3dfc4-dca8-4128-8465-ab48f19727ad]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-94f7a00b-4ee5-4820-abc4-c3e599312d77 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:51 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:51 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-94f7a00b-4ee5-4820-abc4-c3e599312d77 Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.751dd16e-0c36-44a3-8ba9-6a4db05db197" returned: 0 in 0.484s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:51 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-quobyte-751dd16e-0c36-44a3-8ba9-6a4db05db197" released by "_delete_snapshot" :: held 2.234s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-quobyte-52378b05-8b9a-413b-b6ec-0ac59bbdbaab" released by "delete_snapshot" :: held 2.247s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] Created reservations ['b41b21fb-1017-40cb-b8a2-dd049be2a712', 'cbc15961-dae1-4a63-a315-769bc2bdeeb8', '8fa72223-9b6e-4e1a-b004-c2b142e0756b', '5145215e-4ef1-49d0-8d9c-8eb31a73642f'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:51 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] Delete snapshot completed successfully. Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-16ef3b74-0e38-473c-9ab0-a965e1084b95 tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-751dd16e-0c36-44a3-8ba9-6a4db05db197-delete_snapshot" released by "delete_snapshot" :: held 2.360s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:51 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b" returned: 0 in 0.644s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:51 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 Apr 07 06:12:51 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:51 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0" returned: 0 in 0.616s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:51 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0 Apr 07 06:12:51 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:51 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-94f7a00b-4ee5-4820-abc4-c3e599312d77" returned: 0 in 0.607s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-94f7a00b-4ee5-4820-abc4-c3e599312d77 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:51 devstack sudo[88293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-94f7a00b-4ee5-4820-abc4-c3e599312d77 Apr 07 06:12:51 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG oslo_service.periodic_task [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82475) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:51 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:51 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:51 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1" returned: 0 in 0.518s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:51 devstack sudo[88301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1 Apr 07 06:12:51 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:51 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9fde5fd3-b983-493c-a3ee-107a3acc2bb0" returned: 0 in 0.531s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-quobyte-9fde5fd3-b983-493c-a3ee-107a3acc2bb0" released by "delete_volume" :: held 1.204s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] Created reservations ['f21cf379-0898-49c6-a745-2718278e7dc6', '37673cd4-82d4-4171-9498-ce9848ffcc02', '2b3030d2-5947-48cd-b0e2-4bccada5903e', 'e1d83ec1-6227-4a3c-bffd-dcd61ef44128'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] Acquiring lock "cinder-d12a2509-765b-448a-88dd-517eb1f052a6-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-d12a2509-765b-448a-88dd-517eb1f052a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] Acquiring lock "cinder-quobyte-52378b05-8b9a-413b-b6ec-0ac59bbdbaab" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-quobyte-52378b05-8b9a-413b-b6ec-0ac59bbdbaab" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] Acquiring lock "cinder-quobyte-d12a2509-765b-448a-88dd-517eb1f052a6" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-quobyte-d12a2509-765b-448a-88dd-517eb1f052a6" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] Deleting offline snapshot d12a2509-765b-448a-88dd-517eb1f052a6 of volume 52378b05-8b9a-413b-b6ec-0ac59bbdbaab {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] snapshot_file for this snap is: volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b91329-d646-46b0-a301-21a1b2ffd390]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:52 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:52 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:52 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-94f7a00b-4ee5-4820-abc4-c3e599312d77" returned: 0 in 0.584s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] Lock "cinder-quobyte-94f7a00b-4ee5-4820-abc4-c3e599312d77" released by "delete_volume" :: held 1.223s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] Created reservations ['3e5ea2e4-9e4d-497b-9c8e-ab92f8580b1c', '03ef27f8-e0ee-43fb-9b10-bf6d198a5286', 'efd98397-90c5-48d0-af6e-8a32d2f1bab4', '293d0497-0834-43b9-99f3-af8efaa5782e'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:52 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 Apr 07 06:12:52 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:52 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.571s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:52 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:52 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:52 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.4084de92-8fb0-4585-8390-4218279572e1" returned: 0 in 0.644s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f -F qcow2 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:52 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f -F qcow2 Apr 07 06:12:52 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:52 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.555s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:52 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] Deleted volume successfully. Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fbbb12bf-3d23-472b-a2d8-c63c04b3f27a tempest-CreateVolumesFromSnapshotTest-471045403 None] Lock "cinder-9fde5fd3-b983-493c-a3ee-107a3acc2bb0-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:52 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6" returned: 0 in 0.680s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b147edc-35d6-4207-a480-426f2f65ba83]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:52 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.543s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:52 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] Deleted volume successfully. Apr 07 06:12:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0c34eb20-c6fb-4d21-b7a2-ce3a3a081988 tempest-VolumesActionsTest-860442081 None] Lock "cinder-94f7a00b-4ee5-4820-abc4-c3e599312d77-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:53 devstack sudo[88319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab Apr 07 06:12:53 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:53 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f -F qcow2" returned: 0 in 0.488s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-4084de92-8fb0-4585-8390-4218279572e1" released by "_delete_snapshot" :: held 4.819s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b" released by "delete_snapshot" :: held 4.830s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Created reservations ['53b34010-f84c-4933-b29f-ebca77c4c0f4', '96bad9f4-8fb5-48b4-9d56-2e16c448512f', 'e52438bf-892c-4f48-99ea-756f2afeb538', 'b4e7108d-3081-40ec-aa4b-ec87af0bed01'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:53 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Delete snapshot completed successfully. Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-4084de92-8fb0-4585-8390-4218279572e1-delete_snapshot" released by "delete_snapshot" :: held 4.955s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "cinder-68cc475b-5755-4361-a0d1-34c3932c3f4f-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-68cc475b-5755-4361-a0d1-34c3932c3f4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "cinder-quobyte-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "cinder-quobyte-68cc475b-5755-4361-a0d1-34c3932c3f4f" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-68cc475b-5755-4361-a0d1-34c3932c3f4f" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Deleting offline snapshot 68cc475b-5755-4361-a0d1-34c3932c3f4f of volume 290f0ab6-9a0f-4eae-8a6c-ce9c0769130b {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] snapshot_file for this snap is: volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[37699b55-7a87-4a16-87ca-844f61969162]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:53 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f Apr 07 06:12:53 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:53 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Flow 'volume_create_manager' (36c1065c-35f2-44bc-8b54-d38b82ae129f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed31d56-0ee2-4abc-b64f-fc230301e5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed31d56-0ee2-4abc-b64f-fc230301e5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1564950510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2bc4ea3-2380-4f4b-8ae3-212335a17346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056dc663fbc246cb81fe7ef44d880d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:54Z,use_quota=True,user_id='d7726e11612e41b9918305f81a17604a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949a5829-42c1-426e-b47e-619074200b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949a5829-42c1-426e-b47e-619074200b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca92cd5c-a009-4b28-8055-319f0de5628c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca92cd5c-a009-4b28-8055-319f0de5628c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2bc4ea3-2380-4f4b-8ae3-212335a17346', 'volume_name': 'volume-e2bc4ea3-2380-4f4b-8ae3-212335a17346', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7e3a40-7b02-4620-b5e7-792e60e79c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7e3a40-7b02-4620-b5e7-792e60e79c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c4e620-e427-4056-9182-30692ec96d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:53 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Volume e2bc4ea3-2380-4f4b-8ae3-212335a17346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2bc4ea3-2380-4f4b-8ae3-212335a17346', 'volume_size': 1} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1564950510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2bc4ea3-2380-4f4b-8ae3-212335a17346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056dc663fbc246cb81fe7ef44d880d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:54Z,use_quota=True,user_id='d7726e11612e41b9918305f81a17604a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Creating volume e2bc4ea3-2380-4f4b-8ae3-212335a17346 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:53 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e2bc4ea3-2380-4f4b-8ae3-212335a17346 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab" returned: 0 in 0.836s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:53 devstack sudo[88329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e2bc4ea3-2380-4f4b-8ae3-212335a17346 1073741824 Apr 07 06:12:53 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:53 devstack sudo[88330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 Apr 07 06:12:53 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:53 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f" returned: 0 in 0.664s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[40666bbd-4075-4c8e-9b05-0e32b16b9e62]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:54 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b Apr 07 06:12:54 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:54 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6" returned: 0 in 0.561s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:54 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6 Apr 07 06:12:54 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:54 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e2bc4ea3-2380-4f4b-8ae3-212335a17346 1073741824" returned: 0 in 0.725s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e2bc4ea3-2380-4f4b-8ae3-212335a17346 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:54 devstack sudo[88349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e2bc4ea3-2380-4f4b-8ae3-212335a17346 Apr 07 06:12:54 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:54 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b" returned: 0 in 0.617s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:54 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f Apr 07 06:12:54 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:54 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab.d12a2509-765b-448a-88dd-517eb1f052a6" returned: 0 in 0.518s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-quobyte-d12a2509-765b-448a-88dd-517eb1f052a6" released by "_delete_snapshot" :: held 2.679s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-quobyte-52378b05-8b9a-413b-b6ec-0ac59bbdbaab" released by "delete_snapshot" :: held 2.716s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:54 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] Created reservations ['9ec9153c-74a4-48cb-b1f7-77bd35aaf62a', 'a284b296-e6dc-4ff5-8a86-63e55e28028f', 'aaa79035-351a-4ef8-9839-270098985df3', '3c1bddab-0769-43dd-bbef-e2e90206aca8'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:54 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] Delete snapshot completed successfully. Apr 07 06:12:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-aad63393-6e60-44bd-b634-d517ef6dfb8d tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-d12a2509-765b-448a-88dd-517eb1f052a6-delete_snapshot" released by "delete_snapshot" :: held 2.852s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:55 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e2bc4ea3-2380-4f4b-8ae3-212335a17346" returned: 0 in 0.521s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c4e620-e427-4056-9182-30692ec96d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2bc4ea3-2380-4f4b-8ae3-212335a17346', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383ff577-50bf-4dfa-a0a8-04163ea08ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:55 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Volume volume-e2bc4ea3-2380-4f4b-8ae3-212335a17346 (e2bc4ea3-2380-4f4b-8ae3-212335a17346): created successfully Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383ff577-50bf-4dfa-a0a8-04163ea08ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Flow 'volume_create_manager' (36c1065c-35f2-44bc-8b54-d38b82ae129f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:55 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-fe13317c-f2cd-423c-854b-ac7560ef1b5b tempest-VolumesActionsTest-1898711442 None] Created volume successfully. Apr 07 06:12:55 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f" returned: 0 in 0.593s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:55 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f Apr 07 06:12:55 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Flow 'volume_create_manager' (9ea6ecb6-77c2-4f5f-8da4-31a39cbbfbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e37af7-9806-4b39-be0c-14d2dcadff3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] Acquiring lock "cinder-52378b05-8b9a-413b-b6ec-0ac59bbdbaab-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e37af7-9806-4b39-be0c-14d2dcadff3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1358032322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ba9c36-bf39-46e3-851c-c46dfc6106b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d722f86c8642e6a43ad54ed9490a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:55Z,use_quota=True,user_id='119ff010bd584d3e9ecd7a9bf8a6cb25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f97a19-9ee3-41f7-9695-7b4bfc007157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f97a19-9ee3-41f7-9695-7b4bfc007157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9b26db-00fe-41d0-9cfd-3adacd165b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9b26db-00fe-41d0-9cfd-3adacd165b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4ba9c36-bf39-46e3-851c-c46dfc6106b3', 'volume_name': 'volume-e4ba9c36-bf39-46e3-851c-c46dfc6106b3', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa1e644f-93ea-4022-8244-693a82dc86ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa1e644f-93ea-4022-8244-693a82dc86ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2843db3-4719-430a-a0cc-95b460b5866a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:55 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Volume e4ba9c36-bf39-46e3-851c-c46dfc6106b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4ba9c36-bf39-46e3-851c-c46dfc6106b3', 'volume_size': 1} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1358032322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ba9c36-bf39-46e3-851c-c46dfc6106b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d722f86c8642e6a43ad54ed9490a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:55Z,use_quota=True,user_id='119ff010bd584d3e9ecd7a9bf8a6cb25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Creating volume e4ba9c36-bf39-46e3-851c-c46dfc6106b3 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:55 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e4ba9c36-bf39-46e3-851c-c46dfc6106b3 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-52378b05-8b9a-413b-b6ec-0ac59bbdbaab-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:55 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e4ba9c36-bf39-46e3-851c-c46dfc6106b3 1073741824 Apr 07 06:12:55 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] Acquiring lock "cinder-quobyte-52378b05-8b9a-413b-b6ec-0ac59bbdbaab" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-quobyte-52378b05-8b9a-413b-b6ec-0ac59bbdbaab" acquired by "delete_volume" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f275a4-2ed4-4c53-bf82-144eb11e7ae4]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:55 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab Apr 07 06:12:55 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:55 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b.68cc475b-5755-4361-a0d1-34c3932c3f4f" returned: 0 in 0.470s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-68cc475b-5755-4361-a0d1-34c3932c3f4f" released by "_delete_snapshot" :: held 2.421s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b" released by "delete_snapshot" :: held 2.435s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Created reservations ['d6e5fbcc-b2bc-460e-9b31-b3693dbf4a5c', '8f762ac7-d556-488f-b0c3-02bdd3ab6f94', '8b9b84d8-f060-4fe1-8475-8c68a66f3d48', '5f5450d8-f1dd-4e46-9605-94e2979bf64a'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:55 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Delete snapshot completed successfully. Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-68cc475b-5755-4361-a0d1-34c3932c3f4f-delete_snapshot" released by "delete_snapshot" :: held 2.588s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Snapshots deleted, issuing volume delete {{(pid=82475) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "cinder-quobyte-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b" acquired by "delete_volume" :: waited 0.015s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b2d934-6419-4deb-a8d0-bd058fd3e0c3]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:55 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b Apr 07 06:12:55 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:56 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e4ba9c36-bf39-46e3-851c-c46dfc6106b3 1073741824" returned: 0 in 0.652s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e4ba9c36-bf39-46e3-851c-c46dfc6106b3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:56 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e4ba9c36-bf39-46e3-851c-c46dfc6106b3 Apr 07 06:12:56 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:56 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab" returned: 0 in 0.686s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:56 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab Apr 07 06:12:56 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:56 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b" returned: 0 in 0.631s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] Acquiring lock "cinder-e2bc4ea3-2380-4f4b-8ae3-212335a17346-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:56 devstack sudo[88380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b Apr 07 06:12:56 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] Lock "cinder-e2bc4ea3-2380-4f4b-8ae3-212335a17346-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] Acquiring lock "cinder-quobyte-e2bc4ea3-2380-4f4b-8ae3-212335a17346" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] Lock "cinder-quobyte-e2bc4ea3-2380-4f4b-8ae3-212335a17346" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dd5d52-be5a-47c0-82a3-8928681d8ed5]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e2bc4ea3-2380-4f4b-8ae3-212335a17346 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:56 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e4ba9c36-bf39-46e3-851c-c46dfc6106b3" returned: 0 in 0.605s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:56 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e2bc4ea3-2380-4f4b-8ae3-212335a17346 Apr 07 06:12:56 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2843db3-4719-430a-a0cc-95b460b5866a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4ba9c36-bf39-46e3-851c-c46dfc6106b3', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f580d45a-23d2-4372-8c56-631011fccc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:56 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-52378b05-8b9a-413b-b6ec-0ac59bbdbaab" returned: 0 in 0.554s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:56 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Volume volume-e4ba9c36-bf39-46e3-851c-c46dfc6106b3 (e4ba9c36-bf39-46e3-851c-c46dfc6106b3): created successfully Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f580d45a-23d2-4372-8c56-631011fccc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Flow 'volume_create_manager' (9ea6ecb6-77c2-4f5f-8da4-31a39cbbfbc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-quobyte-52378b05-8b9a-413b-b6ec-0ac59bbdbaab" released by "delete_volume" :: held 1.286s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:56 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-7cfcae77-823d-4dec-aa73-96fd908dcc8a tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Created volume successfully. Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] Created reservations ['450d91c2-5a8a-427d-998f-6d1894be8f61', '265fafc7-edc6-4260-88d1-2b16c3d98ec8', '0ee956f6-02f0-42f4-8a55-41dfcb79c8d0', '62a1039f-8a3d-4239-9de2-eda609091d28'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:56 devstack sudo[88386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:56 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:57 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b" returned: 0 in 0.644s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b" released by "delete_volume" :: held 1.305s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:57 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e2bc4ea3-2380-4f4b-8ae3-212335a17346" returned: 0 in 0.550s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e2bc4ea3-2380-4f4b-8ae3-212335a17346 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:57 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e2bc4ea3-2380-4f4b-8ae3-212335a17346 Apr 07 06:12:57 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Created reservations ['6cc01fdf-f9d3-4cb8-8203-cd00855bc99f', '651d44bf-16ae-4418-8154-0dd376ef7b8d', '8e7a9fc4-f08f-414c-baff-88416da7d18e', '238f1914-1bff-463d-ae51-4fe65ac20174'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:57 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:57 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:57 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.505s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:57 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] Deleted volume successfully. Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bcd92210-548f-467d-b15f-ad9b0e23b0fb tempest-VolumesSnapshotListTestJSON-303684822 None] Lock "cinder-52378b05-8b9a-413b-b6ec-0ac59bbdbaab-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:57 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e2bc4ea3-2380-4f4b-8ae3-212335a17346" returned: 0 in 0.487s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] Lock "cinder-quobyte-e2bc4ea3-2380-4f4b-8ae3-212335a17346" released by "delete_volume" :: held 1.061s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] Created reservations ['e06dfbc8-32bc-4fc0-b67d-0f4a28906a59', '396e963c-9ae7-4f5b-afec-e4010907633e', 'afc15151-5482-4d62-81cc-30c9e2fbbaea', 'f4c0596b-430a-4b81-8914-4af869514498'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:12:57 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.506s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:57 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Deleted volume successfully. Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ff38ebe8-e682-4b99-a6ac-937839c427b4 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-290f0ab6-9a0f-4eae-8a6c-ce9c0769130b-delete_volume" released by "delete_volume" :: held 9.578s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:57 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:12:57 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Flow 'volume_create_manager' (49d6f647-2dcd-42ac-8e15-706ddd6363ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:57 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7871202-b68d-47fe-8d83-acfaeffa875b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7871202-b68d-47fe-8d83-acfaeffa875b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1859030301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e078ec0-aca9-4217-8621-920163c81b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d722f86c8642e6a43ad54ed9490a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:58Z,use_quota=True,user_id='119ff010bd584d3e9ecd7a9bf8a6cb25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b23add-e204-47e7-88c7-ba8c66f17076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b23add-e204-47e7-88c7-ba8c66f17076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1849e845-bed5-49ba-be05-8698ffd4e450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1849e845-bed5-49ba-be05-8698ffd4e450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e078ec0-aca9-4217-8621-920163c81b07', 'volume_name': 'volume-7e078ec0-aca9-4217-8621-920163c81b07', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2787189e-c4b9-4551-88d7-74211f7f1994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2787189e-c4b9-4551-88d7-74211f7f1994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d27da2f-be56-4698-a7ff-c0df6f774368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Volume 7e078ec0-aca9-4217-8621-920163c81b07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e078ec0-aca9-4217-8621-920163c81b07', 'volume_size': 1} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1859030301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e078ec0-aca9-4217-8621-920163c81b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d722f86c8642e6a43ad54ed9490a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:58Z,use_quota=True,user_id='119ff010bd584d3e9ecd7a9bf8a6cb25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Creating volume 7e078ec0-aca9-4217-8621-920163c81b07 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:58 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7e078ec0-aca9-4217-8621-920163c81b07 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:58 devstack sudo[88401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7e078ec0-aca9-4217-8621-920163c81b07 1073741824 Apr 07 06:12:58 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Flow 'volume_create_manager' (d2624098-9fa8-4aeb-887c-e1aa61ce35f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6bd853-e811-4b80-be30-071cd44b51ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6bd853-e811-4b80-be30-071cd44b51ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-332964078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b0d9ad-ef50-4990-b764-38e06afbca48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d722f86c8642e6a43ad54ed9490a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:58Z,use_quota=True,user_id='119ff010bd584d3e9ecd7a9bf8a6cb25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174faf94-f0ba-4655-aed7-ffd893f8ed20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174faf94-f0ba-4655-aed7-ffd893f8ed20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6dcf3af-9aba-4191-a064-194a208cf9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6dcf3af-9aba-4191-a064-194a208cf9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8b0d9ad-ef50-4990-b764-38e06afbca48', 'volume_name': 'volume-a8b0d9ad-ef50-4990-b764-38e06afbca48', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b8acca-a807-49a5-bd04-baf612d3b087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b8acca-a807-49a5-bd04-baf612d3b087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a86d03-cf70-4655-9ac4-c8ddbfd0b0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Volume a8b0d9ad-ef50-4990-b764-38e06afbca48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8b0d9ad-ef50-4990-b764-38e06afbca48', 'volume_size': 1} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Flow 'volume_create_manager' (b4b4fbdc-3e29-4249-8f9d-9682a0bb6792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d161a7cb-d3d4-4c08-ad9d-deb8e8bfa1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d161a7cb-d3d4-4c08-ad9d-deb8e8bfa1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-793792371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fdda8a-517a-4652-8236-f7b6e74f7c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7816f2a9bddc49e594c9f7c58f22c5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:58Z,use_quota=True,user_id='8996444800db4cd2a58a9ed8a0de0ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7de0e3-3787-4290-8680-f540f925946b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7de0e3-3787-4290-8680-f540f925946b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6eca1af-897a-4652-a957-d22401910a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6eca1af-897a-4652-a957-d22401910a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99fdda8a-517a-4652-8236-f7b6e74f7c8d', 'volume_name': 'volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a548f7c2-3e0e-4feb-a982-4e67f3bfc0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a548f7c2-3e0e-4feb-a982-4e67f3bfc0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ee9442-f6de-4cdd-b6d3-ffebf7afb4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Volume 99fdda8a-517a-4652-8236-f7b6e74f7c8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d', 'volume_size': 1} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:58 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.886s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:12:58 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] Deleted volume successfully. Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ab5f5d7b-905e-4b87-b3ac-270f01d09745 tempest-VolumesActionsTest-1898711442 None] Lock "cinder-e2bc4ea3-2380-4f4b-8ae3-212335a17346-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Flow 'volume_create_manager' (ede0950a-9c43-4937-b2a8-0bfc85ae4155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f4d66a-c8f8-40f0-843c-1e87facfd156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f4d66a-c8f8-40f0-843c-1e87facfd156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1725775192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d722f86c8642e6a43ad54ed9490a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:59Z,use_quota=True,user_id='119ff010bd584d3e9ecd7a9bf8a6cb25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ce3326-1b64-45ba-ac17-c2d0fe371c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ce3326-1b64-45ba-ac17-c2d0fe371c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cda4233-1400-4e7c-8d60-54483d8583a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cda4233-1400-4e7c-8d60-54483d8583a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2', 'volume_name': 'volume-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deecc1ff-c398-4e57-8500-f5c29ffefa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deecc1ff-c398-4e57-8500-f5c29ffefa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1804be-af33-4dac-8dbf-b90483329ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:58 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Volume 81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2', 'volume_size': 1} Apr 07 06:12:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:59 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7e078ec0-aca9-4217-8621-920163c81b07 1073741824" returned: 0 in 1.077s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Flow 'volume_create_manager' (c556eeca-da37-498a-9a53-6023ad909e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27587dad-0d9d-4ea8-b88a-b254f5b939a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27587dad-0d9d-4ea8-b88a-b254f5b939a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1001245994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c142fc03-697c-403e-987d-1384b0879017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d722f86c8642e6a43ad54ed9490a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:59Z,use_quota=True,user_id='119ff010bd584d3e9ecd7a9bf8a6cb25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c361de-6d41-42a7-9764-702380632b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c361de-6d41-42a7-9764-702380632b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57787c74-4674-4bba-8212-2222aba22680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57787c74-4674-4bba-8212-2222aba22680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c142fc03-697c-403e-987d-1384b0879017', 'volume_name': 'volume-c142fc03-697c-403e-987d-1384b0879017', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a1896c-f625-4002-b54d-5043be739569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a1896c-f625-4002-b54d-5043be739569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43fd495e-fb21-4e01-8384-53c09b044103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:59 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Volume c142fc03-697c-403e-987d-1384b0879017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c142fc03-697c-403e-987d-1384b0879017', 'volume_size': 1} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7e078ec0-aca9-4217-8621-920163c81b07 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:59 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7e078ec0-aca9-4217-8621-920163c81b07 Apr 07 06:12:59 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Flow 'volume_create_manager' (c0134816-108c-4403-8078-4c3e5e11f93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b73c4f1e-c032-40f1-8c76-9ef9bbbf2498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b73c4f1e-c032-40f1-8c76-9ef9bbbf2498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1960575889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128b9e1d-fa93-4368-b78e-0989cb06a514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d722f86c8642e6a43ad54ed9490a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:59Z,use_quota=True,user_id='119ff010bd584d3e9ecd7a9bf8a6cb25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1ad18c-e48a-482f-aa0b-7d0a0d027c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1ad18c-e48a-482f-aa0b-7d0a0d027c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84842192-619f-48a2-bd76-df845f040866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84842192-619f-48a2-bd76-df845f040866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '128b9e1d-fa93-4368-b78e-0989cb06a514', 'volume_name': 'volume-128b9e1d-fa93-4368-b78e-0989cb06a514', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4dc9710-36f8-4f9c-befd-3e058eb79077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4dc9710-36f8-4f9c-befd-3e058eb79077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ab2bff-37a9-432d-9bf3-f5176a59f0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:59 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Volume 128b9e1d-fa93-4368-b78e-0989cb06a514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-128b9e1d-fa93-4368-b78e-0989cb06a514', 'volume_size': 1} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:59 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7e078ec0-aca9-4217-8621-920163c81b07" returned: 0 in 0.519s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-332964078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b0d9ad-ef50-4990-b764-38e06afbca48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d722f86c8642e6a43ad54ed9490a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:58Z,use_quota=True,user_id='119ff010bd584d3e9ecd7a9bf8a6cb25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Creating volume a8b0d9ad-ef50-4990-b764-38e06afbca48 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:12:59 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a8b0d9ad-ef50-4990-b764-38e06afbca48 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d27da2f-be56-4698-a7ff-c0df6f774368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e078ec0-aca9-4217-8621-920163c81b07', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2bdad35-29e1-4965-be2a-02093f96dcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:12:59 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a8b0d9ad-ef50-4990-b764-38e06afbca48 1073741824 Apr 07 06:12:59 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:12:59 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Volume volume-7e078ec0-aca9-4217-8621-920163c81b07 (7e078ec0-aca9-4217-8621-920163c81b07): created successfully Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2bdad35-29e1-4965-be2a-02093f96dcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:12:59 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Flow 'volume_create_manager' (49d6f647-2dcd-42ac-8e15-706ddd6363ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:12:59 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-838843f8-389a-4d65-ab53-1585917ebf1c tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Created volume successfully. Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Flow 'volume_create_manager' (286e99d1-ebd9-40ce-980c-47c6df70a435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a120ca-fa8a-4ce3-9134-018c804982b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a120ca-fa8a-4ce3-9134-018c804982b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1730912294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb029af-830f-4d96-9915-acb46204f25f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f23a52d5f747a48432004951587dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:00Z,use_quota=True,user_id='061fb6c450d04d8cad2c4ad773dcf5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e55fee6f-9d55-4e64-ab83-e0a0b8f53138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e55fee6f-9d55-4e64-ab83-e0a0b8f53138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d85cf9-6a58-44ae-8399-a4657a1f6232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d85cf9-6a58-44ae-8399-a4657a1f6232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceb029af-830f-4d96-9915-acb46204f25f', 'volume_name': 'volume-ceb029af-830f-4d96-9915-acb46204f25f', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eefadc3-cc1d-4d6a-84f8-28dcfaa4033c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eefadc3-cc1d-4d6a-84f8-28dcfaa4033c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17193a87-ff9f-40b6-adf9-89730ec3d498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:00 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Volume ceb029af-830f-4d96-9915-acb46204f25f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceb029af-830f-4d96-9915-acb46204f25f', 'volume_size': 1} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Flow 'volume_create_manager' (52cdee9c-49a9-45c6-b267-075569e7e427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d525756c-4573-4b87-9695-5628aac56d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d525756c-4573-4b87-9695-5628aac56d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1775430174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68161946-c2d7-4a8e-9ee6-37899c656c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f23a52d5f747a48432004951587dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:00Z,use_quota=True,user_id='061fb6c450d04d8cad2c4ad773dcf5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae82a87-8e9e-4e5c-8caa-c9419441b724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae82a87-8e9e-4e5c-8caa-c9419441b724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8efaa5c-2ee7-46c8-b21a-b1094a570b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8efaa5c-2ee7-46c8-b21a-b1094a570b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68161946-c2d7-4a8e-9ee6-37899c656c8d', 'volume_name': 'volume-68161946-c2d7-4a8e-9ee6-37899c656c8d', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13b5b32-65f0-4b46-a223-5e0133a65606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13b5b32-65f0-4b46-a223-5e0133a65606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcbd7ee9-d6c5-47fc-8d53-32c315a2ab9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:00 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Volume 68161946-c2d7-4a8e-9ee6-37899c656c8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68161946-c2d7-4a8e-9ee6-37899c656c8d', 'volume_size': 1} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:00 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a8b0d9ad-ef50-4990-b764-38e06afbca48 1073741824" returned: 0 in 0.638s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a8b0d9ad-ef50-4990-b764-38e06afbca48 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:00 devstack sudo[88417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a8b0d9ad-ef50-4990-b764-38e06afbca48 Apr 07 06:13:00 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Flow 'volume_create_manager' (24cc685d-7afe-4300-9e64-224a412df4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b03fdd-9cfe-4ed8-bbc8-0e3610ef2aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b03fdd-9cfe-4ed8-bbc8-0e3610ef2aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-474480794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66671787-48b1-4117-babf-21883012f6a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f23a52d5f747a48432004951587dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:01Z,use_quota=True,user_id='061fb6c450d04d8cad2c4ad773dcf5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df06026f-d438-48c3-98c1-61a367760ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df06026f-d438-48c3-98c1-61a367760ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a9c429-b669-4d45-bfa5-fcc2e66008e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a9c429-b669-4d45-bfa5-fcc2e66008e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66671787-48b1-4117-babf-21883012f6a9', 'volume_name': 'volume-66671787-48b1-4117-babf-21883012f6a9', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb75316-41f0-4393-b0b4-6722ca4733c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb75316-41f0-4393-b0b4-6722ca4733c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a1550f2-8d08-4692-94c4-011912e44c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:00 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Volume 66671787-48b1-4117-babf-21883012f6a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66671787-48b1-4117-babf-21883012f6a9', 'volume_size': 1} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Flow 'volume_create_manager' (5af4d534-4400-462d-826a-d78781b75a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b8a0a9-0cbd-4078-bf5e-1d1eac13d3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b8a0a9-0cbd-4078-bf5e-1d1eac13d3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-584372611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61db24e8-7dd0-48ea-aa2e-991e31ed3456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f23a52d5f747a48432004951587dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:01Z,use_quota=True,user_id='061fb6c450d04d8cad2c4ad773dcf5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc43be1-700f-4ad5-9c18-daa5b2793690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc43be1-700f-4ad5-9c18-daa5b2793690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb211475-2236-4289-bb29-8d1c0d85a690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb211475-2236-4289-bb29-8d1c0d85a690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61db24e8-7dd0-48ea-aa2e-991e31ed3456', 'volume_name': 'volume-61db24e8-7dd0-48ea-aa2e-991e31ed3456', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (435a7f81-9b36-4241-a949-795f6dc40979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:00 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (435a7f81-9b36-4241-a949-795f6dc40979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f08659-291f-4bc6-959a-2a921ec4154d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:01 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Volume 61db24e8-7dd0-48ea-aa2e-991e31ed3456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61db24e8-7dd0-48ea-aa2e-991e31ed3456', 'volume_size': 1} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:01 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a8b0d9ad-ef50-4990-b764-38e06afbca48" returned: 0 in 0.695s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.616s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-793792371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fdda8a-517a-4652-8236-f7b6e74f7c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7816f2a9bddc49e594c9f7c58f22c5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:58Z,use_quota=True,user_id='8996444800db4cd2a58a9ed8a0de0ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Creating volume 99fdda8a-517a-4652-8236-f7b6e74f7c8d {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:01 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a86d03-cf70-4655-9ac4-c8ddbfd0b0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b0d9ad-ef50-4990-b764-38e06afbca48', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67769a0-b412-4a2f-bd30-9cc4b4a21e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:01 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d 1073741824 Apr 07 06:13:01 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Flow 'volume_create_manager' (046fa485-783e-4e3e-898d-17c296e46240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32e5a671-8e0e-4069-b15e-4611233e609a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:01 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Volume volume-a8b0d9ad-ef50-4990-b764-38e06afbca48 (a8b0d9ad-ef50-4990-b764-38e06afbca48): created successfully Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67769a0-b412-4a2f-bd30-9cc4b4a21e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Flow 'volume_create_manager' (d2624098-9fa8-4aeb-887c-e1aa61ce35f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:01 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d3046bca-0cf0-457c-81e3-470c08344579 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Created volume successfully. Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32e5a671-8e0e-4069-b15e-4611233e609a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-417339747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd0ca5b2-0b91-45aa-a70a-c30ca5071425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f23a52d5f747a48432004951587dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:01Z,use_quota=True,user_id='061fb6c450d04d8cad2c4ad773dcf5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74cbe594-5018-44a9-8d73-c725672277e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74cbe594-5018-44a9-8d73-c725672277e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00eb8c1f-ff86-42ec-a9c9-96f06f07d686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00eb8c1f-ff86-42ec-a9c9-96f06f07d686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd0ca5b2-0b91-45aa-a70a-c30ca5071425', 'volume_name': 'volume-dd0ca5b2-0b91-45aa-a70a-c30ca5071425', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e837d46c-c7ba-4719-aa13-db9c90291545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e837d46c-c7ba-4719-aa13-db9c90291545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f509050-d8c7-4460-9202-04cccd3447c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:01 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Volume dd0ca5b2-0b91-45aa-a70a-c30ca5071425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd0ca5b2-0b91-45aa-a70a-c30ca5071425', 'volume_size': 1} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:01 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d 1073741824" returned: 0 in 0.662s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:01 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d Apr 07 06:13:01 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:02 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d" returned: 0 in 0.479s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.536s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1725775192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d722f86c8642e6a43ad54ed9490a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:59Z,use_quota=True,user_id='119ff010bd584d3e9ecd7a9bf8a6cb25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Creating volume 81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:02 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:13:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:02 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ee9442-f6de-4cdd-b6d3-ffebf7afb4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:02 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2 1073741824 Apr 07 06:13:02 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27bfd231-fa69-491b-bfc4-1a1d698a98a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:02 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:02 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Volume volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d (99fdda8a-517a-4652-8236-f7b6e74f7c8d): created successfully Apr 07 06:13:02 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27bfd231-fa69-491b-bfc4-1a1d698a98a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:02 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Flow 'volume_create_manager' (b4b4fbdc-3e29-4249-8f9d-9682a0bb6792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:02 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-1a4ee97c-27e7-4be8-a10a-ae594deed4cf tempest-VolumesDeleteCascade-1794776792 None] Created volume successfully. Apr 07 06:13:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e534359c-4867-451b-8834-8c179573ae70 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:03 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2 1073741824" returned: 0 in 0.581s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:03 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2 Apr 07 06:13:03 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:03 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2" returned: 0 in 0.538s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.239s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1001245994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c142fc03-697c-403e-987d-1384b0879017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d722f86c8642e6a43ad54ed9490a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:59Z,use_quota=True,user_id='119ff010bd584d3e9ecd7a9bf8a6cb25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Creating volume c142fc03-697c-403e-987d-1384b0879017 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:03 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:13:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c142fc03-697c-403e-987d-1384b0879017 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:03 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1804be-af33-4dac-8dbf-b90483329ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:03 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c142fc03-697c-403e-987d-1384b0879017 1073741824 Apr 07 06:13:03 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203a7183-81f8-4b29-8a67-ac04861e1c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:03 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:03 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Volume volume-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2 (81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2): created successfully Apr 07 06:13:03 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203a7183-81f8-4b29-8a67-ac04861e1c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:03 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Flow 'volume_create_manager' (ede0950a-9c43-4937-b2a8-0bfc85ae4155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:03 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-831e5858-8168-4bec-a53b-8a107daaec51 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Created volume successfully. Apr 07 06:13:04 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c142fc03-697c-403e-987d-1384b0879017 1073741824" returned: 0 in 0.828s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c142fc03-697c-403e-987d-1384b0879017 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:04 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c142fc03-697c-403e-987d-1384b0879017 Apr 07 06:13:04 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:05 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c142fc03-697c-403e-987d-1384b0879017" returned: 0 in 0.645s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:05 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.529s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:05 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1960575889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128b9e1d-fa93-4368-b78e-0989cb06a514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d722f86c8642e6a43ad54ed9490a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:12:59Z,use_quota=True,user_id='119ff010bd584d3e9ecd7a9bf8a6cb25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:05 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Creating volume 128b9e1d-fa93-4368-b78e-0989cb06a514 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:05 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:05 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:05 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:05 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:13:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-128b9e1d-fa93-4368-b78e-0989cb06a514 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:05 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43fd495e-fb21-4e01-8384-53c09b044103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c142fc03-697c-403e-987d-1384b0879017', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:05 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-128b9e1d-fa93-4368-b78e-0989cb06a514 1073741824 Apr 07 06:13:05 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:05 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (011228bf-8277-4fa1-969f-a6fd44524ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:05 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Volume volume-c142fc03-697c-403e-987d-1384b0879017 (c142fc03-697c-403e-987d-1384b0879017): created successfully Apr 07 06:13:05 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (011228bf-8277-4fa1-969f-a6fd44524ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:05 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Flow 'volume_create_manager' (c556eeca-da37-498a-9a53-6023ad909e82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:05 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-c13257ef-616a-44ba-ad58-fb5ad9cbb5e4 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Created volume successfully. Apr 07 06:13:05 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-128b9e1d-fa93-4368-b78e-0989cb06a514 1073741824" returned: 0 in 0.583s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-128b9e1d-fa93-4368-b78e-0989cb06a514 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:05 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-128b9e1d-fa93-4368-b78e-0989cb06a514 Apr 07 06:13:05 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:06 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-128b9e1d-fa93-4368-b78e-0989cb06a514" returned: 0 in 0.506s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:06 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.128s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:06 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1730912294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb029af-830f-4d96-9915-acb46204f25f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f23a52d5f747a48432004951587dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:00Z,use_quota=True,user_id='061fb6c450d04d8cad2c4ad773dcf5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:06 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Creating volume ceb029af-830f-4d96-9915-acb46204f25f {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:06 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:06 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:06 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:06 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:13:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ceb029af-830f-4d96-9915-acb46204f25f 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:06 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ab2bff-37a9-432d-9bf3-f5176a59f0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-128b9e1d-fa93-4368-b78e-0989cb06a514', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:06 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de69229d-a1f8-4cd7-bded-e728662f14cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:06 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ceb029af-830f-4d96-9915-acb46204f25f 1073741824 Apr 07 06:13:06 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:06 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Volume volume-128b9e1d-fa93-4368-b78e-0989cb06a514 (128b9e1d-fa93-4368-b78e-0989cb06a514): created successfully Apr 07 06:13:06 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de69229d-a1f8-4cd7-bded-e728662f14cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:06 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Flow 'volume_create_manager' (c0134816-108c-4403-8078-4c3e5e11f93b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:06 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-11045859-ee9c-4068-be96-2006b80b3e48 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Created volume successfully. Apr 07 06:13:06 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ceb029af-830f-4d96-9915-acb46204f25f 1073741824" returned: 0 in 0.573s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ceb029af-830f-4d96-9915-acb46204f25f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:06 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ceb029af-830f-4d96-9915-acb46204f25f Apr 07 06:13:06 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "cinder-128b9e1d-fa93-4368-b78e-0989cb06a514-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-128b9e1d-fa93-4368-b78e-0989cb06a514-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "cinder-quobyte-128b9e1d-fa93-4368-b78e-0989cb06a514" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-quobyte-128b9e1d-fa93-4368-b78e-0989cb06a514" acquired by "delete_volume" :: waited 0.024s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[645930d0-48a5-48f7-afdb-9c2c1bb432d7]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-128b9e1d-fa93-4368-b78e-0989cb06a514 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:07 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ceb029af-830f-4d96-9915-acb46204f25f" returned: 0 in 0.498s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.895s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1775430174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68161946-c2d7-4a8e-9ee6-37899c656c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f23a52d5f747a48432004951587dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:00Z,use_quota=True,user_id='061fb6c450d04d8cad2c4ad773dcf5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Creating volume 68161946-c2d7-4a8e-9ee6-37899c656c8d {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:07 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-68161946-c2d7-4a8e-9ee6-37899c656c8d 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17193a87-ff9f-40b6-adf9-89730ec3d498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceb029af-830f-4d96-9915-acb46204f25f', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44845f34-9f8f-40b9-8112-2ef3585bf115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:07 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-68161946-c2d7-4a8e-9ee6-37899c656c8d 1073741824 Apr 07 06:13:07 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:07 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Volume volume-ceb029af-830f-4d96-9915-acb46204f25f (ceb029af-830f-4d96-9915-acb46204f25f): created successfully Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44845f34-9f8f-40b9-8112-2ef3585bf115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Flow 'volume_create_manager' (286e99d1-ebd9-40ce-980c-47c6df70a435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:07 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-7f4dca1f-cffb-472f-8fb9-25fc8e8e65d6 tempest-CreateVolumesFromImageTest-651895446 None] Created volume successfully. Apr 07 06:13:07 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-128b9e1d-fa93-4368-b78e-0989cb06a514 Apr 07 06:13:07 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:07 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-128b9e1d-fa93-4368-b78e-0989cb06a514" returned: 0 in 0.649s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-128b9e1d-fa93-4368-b78e-0989cb06a514 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:07 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-68161946-c2d7-4a8e-9ee6-37899c656c8d 1073741824" returned: 0 in 0.633s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:07 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-128b9e1d-fa93-4368-b78e-0989cb06a514 Apr 07 06:13:07 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-68161946-c2d7-4a8e-9ee6-37899c656c8d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:08 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-68161946-c2d7-4a8e-9ee6-37899c656c8d Apr 07 06:13:08 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:08 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-128b9e1d-fa93-4368-b78e-0989cb06a514" returned: 0 in 0.496s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-quobyte-128b9e1d-fa93-4368-b78e-0989cb06a514" released by "delete_volume" :: held 1.172s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:08 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-68161946-c2d7-4a8e-9ee6-37899c656c8d" returned: 0 in 0.485s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.759s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-474480794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66671787-48b1-4117-babf-21883012f6a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f23a52d5f747a48432004951587dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:01Z,use_quota=True,user_id='061fb6c450d04d8cad2c4ad773dcf5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Creating volume 66671787-48b1-4117-babf-21883012f6a9 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:08 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66671787-48b1-4117-babf-21883012f6a9 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcbd7ee9-d6c5-47fc-8d53-32c315a2ab9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68161946-c2d7-4a8e-9ee6-37899c656c8d', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:08 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66671787-48b1-4117-babf-21883012f6a9 1073741824 Apr 07 06:13:08 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd9a417-98e0-4512-90ef-7cfd4535e1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:08 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Volume volume-68161946-c2d7-4a8e-9ee6-37899c656c8d (68161946-c2d7-4a8e-9ee6-37899c656c8d): created successfully Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd9a417-98e0-4512-90ef-7cfd4535e1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Flow 'volume_create_manager' (52cdee9c-49a9-45c6-b267-075569e7e427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Created reservations ['67fdaaef-1241-4d0e-bc8b-bb0db09d94be', '3d08929e-eb4e-4dde-9bc9-b0ebc30d6cbc', '6a2bc488-7e7e-4dbf-955f-a57661d9b80d', '1d67a70a-a229-4a96-b28c-54702e85a56c'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:08 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d6107c16-256b-432e-b50e-2c3f582baae8 tempest-CreateVolumesFromImageTest-651895446 None] Created volume successfully. Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:08 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:08 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:09 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66671787-48b1-4117-babf-21883012f6a9 1073741824" returned: 0 in 0.639s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:09 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.551s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66671787-48b1-4117-babf-21883012f6a9 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:09 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Deleted volume successfully. Apr 07 06:13:09 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66671787-48b1-4117-babf-21883012f6a9 Apr 07 06:13:09 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-223e8c09-dad3-4b33-924c-c26dd66fee86 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-128b9e1d-fa93-4368-b78e-0989cb06a514-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "cinder-c142fc03-697c-403e-987d-1384b0879017-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-c142fc03-697c-403e-987d-1384b0879017-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "cinder-quobyte-c142fc03-697c-403e-987d-1384b0879017" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-quobyte-c142fc03-697c-403e-987d-1384b0879017" acquired by "delete_volume" :: waited 0.022s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[203a51e3-78cc-436a-b3ef-0b1c9a37fae2]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c142fc03-697c-403e-987d-1384b0879017 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:09 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c142fc03-697c-403e-987d-1384b0879017 Apr 07 06:13:09 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Flow 'volume_create_manager' (89c78da3-1db6-4f50-b1cf-a90c163f04ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fdb182-0c01-41e9-9b0d-60ea7b26b73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fdb182-0c01-41e9-9b0d-60ea7b26b73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1383140046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04901927-3ce7-489f-ac6c-a41cc88c7653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b339f8f31fa0427084bb0386f226c1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:10Z,use_quota=True,user_id='cf88251c3a1a46239e7e4f664248bcc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036b5540-a211-4eae-95f9-6a5d19e3d39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036b5540-a211-4eae-95f9-6a5d19e3d39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547dbbe1-2ac5-4300-9d48-18210423655e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547dbbe1-2ac5-4300-9d48-18210423655e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04901927-3ce7-489f-ac6c-a41cc88c7653', 'volume_name': 'volume-04901927-3ce7-489f-ac6c-a41cc88c7653', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13cb064-3a0c-4cbd-90ca-17a1e8e6dd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13cb064-3a0c-4cbd-90ca-17a1e8e6dd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e116a8b4-62d7-466e-a0ae-95539f37a87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:09 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Volume 04901927-3ce7-489f-ac6c-a41cc88c7653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04901927-3ce7-489f-ac6c-a41cc88c7653', 'volume_size': 1} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:09 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66671787-48b1-4117-babf-21883012f6a9" returned: 0 in 0.541s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.721s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-584372611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61db24e8-7dd0-48ea-aa2e-991e31ed3456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f23a52d5f747a48432004951587dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:01Z,use_quota=True,user_id='061fb6c450d04d8cad2c4ad773dcf5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Creating volume 61db24e8-7dd0-48ea-aa2e-991e31ed3456 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:09 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-61db24e8-7dd0-48ea-aa2e-991e31ed3456 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a1550f2-8d08-4692-94c4-011912e44c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66671787-48b1-4117-babf-21883012f6a9', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:09 devstack sudo[88502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-61db24e8-7dd0-48ea-aa2e-991e31ed3456 1073741824 Apr 07 06:13:09 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4a851a-6022-40cc-9458-11034ae326e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:09 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Volume volume-66671787-48b1-4117-babf-21883012f6a9 (66671787-48b1-4117-babf-21883012f6a9): created successfully Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4a851a-6022-40cc-9458-11034ae326e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Flow 'volume_create_manager' (24cc685d-7afe-4300-9e64-224a412df4f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:09 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-ba443acf-4ae8-40bd-8328-aa2daf2b8497 tempest-CreateVolumesFromImageTest-651895446 None] Created volume successfully. Apr 07 06:13:10 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c142fc03-697c-403e-987d-1384b0879017" returned: 0 in 0.580s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c142fc03-697c-403e-987d-1384b0879017 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:10 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c142fc03-697c-403e-987d-1384b0879017 Apr 07 06:13:10 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:10 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-61db24e8-7dd0-48ea-aa2e-991e31ed3456 1073741824" returned: 0 in 0.472s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-61db24e8-7dd0-48ea-aa2e-991e31ed3456 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:10 devstack sudo[88512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-61db24e8-7dd0-48ea-aa2e-991e31ed3456 Apr 07 06:13:10 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:10 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c142fc03-697c-403e-987d-1384b0879017" returned: 0 in 0.442s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-quobyte-c142fc03-697c-403e-987d-1384b0879017" released by "delete_volume" :: held 1.052s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Created reservations ['2f6a3ccb-318d-42c9-813e-f2635d189602', '5ff2eac5-d468-49db-8f75-31f1ca90df63', '2016d151-40a5-45c8-ad5e-97cda6a600ac', '9216113c-4f98-4a72-bdca-90c5d7b9e1cd'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:10 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-61db24e8-7dd0-48ea-aa2e-991e31ed3456" returned: 0 in 0.434s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.298s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-417339747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd0ca5b2-0b91-45aa-a70a-c30ca5071425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f23a52d5f747a48432004951587dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:01Z,use_quota=True,user_id='061fb6c450d04d8cad2c4ad773dcf5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Creating volume dd0ca5b2-0b91-45aa-a70a-c30ca5071425 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:10 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd0ca5b2-0b91-45aa-a70a-c30ca5071425 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:10 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd0ca5b2-0b91-45aa-a70a-c30ca5071425 1073741824 Apr 07 06:13:10 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f08659-291f-4bc6-959a-2a921ec4154d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61db24e8-7dd0-48ea-aa2e-991e31ed3456', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73e5432-6bee-4568-a618-426bb6e47a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:10 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:10 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:10 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Volume volume-61db24e8-7dd0-48ea-aa2e-991e31ed3456 (61db24e8-7dd0-48ea-aa2e-991e31ed3456): created successfully Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73e5432-6bee-4568-a618-426bb6e47a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Flow 'volume_create_manager' (5af4d534-4400-462d-826a-d78781b75a2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:10 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-2be2eea7-5bb0-4c45-8bf8-f68e0824c5b5 tempest-CreateVolumesFromImageTest-651895446 None] Created volume successfully. Apr 07 06:13:11 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.451s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:11 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Deleted volume successfully. Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-0cef644f-b417-4ce3-82e5-273d4a4bb4d6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-c142fc03-697c-403e-987d-1384b0879017-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:11 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd0ca5b2-0b91-45aa-a70a-c30ca5071425 1073741824" returned: 0 in 0.522s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd0ca5b2-0b91-45aa-a70a-c30ca5071425 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:11 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd0ca5b2-0b91-45aa-a70a-c30ca5071425 Apr 07 06:13:11 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:11 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd0ca5b2-0b91-45aa-a70a-c30ca5071425" returned: 0 in 0.440s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "cinder-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e534359c-4867-451b-8834-8c179573ae70 tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.784s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-e534359c-4867-451b-8834-8c179573ae70 tempest-VolumesDeleteCascade-1794776792 None] Creating offline snapshot 5dbcfddc-ec35-45da-a5ca-417a13995a7c of volume 99fdda8a-517a-4652-8236-f7b6e74f7c8d {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f509050-d8c7-4460-9202-04cccd3447c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd0ca5b2-0b91-45aa-a70a-c30ca5071425', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb8ba35-de82-4b34-a721-2ee7d0c8ec1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ebbbb2-c0fe-4378-88ac-b89a71d988e9]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e534359c-4867-451b-8834-8c179573ae70 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:11 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Volume volume-dd0ca5b2-0b91-45aa-a70a-c30ca5071425 (dd0ca5b2-0b91-45aa-a70a-c30ca5071425): created successfully Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb8ba35-de82-4b34-a721-2ee7d0c8ec1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Flow 'volume_create_manager' (046fa485-783e-4e3e-898d-17c296e46240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:11 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-ec034dd0-9cf3-4d4a-a2cc-c65f633fbdac tempest-CreateVolumesFromImageTest-651895446 None] Created volume successfully. Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "cinder-quobyte-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-quobyte-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2" acquired by "delete_volume" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1ea273-c585-404e-bf86-9b48243ab77f]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:11 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d Apr 07 06:13:11 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:11 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2 Apr 07 06:13:11 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "cinder-dd0ca5b2-0b91-45aa-a70a-c30ca5071425-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-dd0ca5b2-0b91-45aa-a70a-c30ca5071425-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "cinder-quobyte-dd0ca5b2-0b91-45aa-a70a-c30ca5071425" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-quobyte-dd0ca5b2-0b91-45aa-a70a-c30ca5071425" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:12 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[013c76dd-1d17-4def-97bb-f35925569e90]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd0ca5b2-0b91-45aa-a70a-c30ca5071425 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:12 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd0ca5b2-0b91-45aa-a70a-c30ca5071425 Apr 07 06:13:12 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:12 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e534359c-4867-451b-8834-8c179573ae70 tempest-VolumesDeleteCascade-1794776792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d" returned: 0 in 0.585s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e534359c-4867-451b-8834-8c179573ae70 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:12 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c 1G Apr 07 06:13:12 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:12 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2" returned: 0 in 0.555s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:12 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2 Apr 07 06:13:12 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:12 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd0ca5b2-0b91-45aa-a70a-c30ca5071425" returned: 0 in 0.598s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd0ca5b2-0b91-45aa-a70a-c30ca5071425 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:12 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd0ca5b2-0b91-45aa-a70a-c30ca5071425 Apr 07 06:13:12 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:12 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2" returned: 0 in 0.524s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-quobyte-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2" released by "delete_volume" :: held 1.102s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:12 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:UPDATE=283,cinder:SELECT=198,cinder:INSERT=64,cinder:DELETE=25 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:13:12 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:12 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:SELECT=201,cinder:INSERT=65,cinder:UPDATE=262,cinder:DELETE=26 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:13:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e534359c-4867-451b-8834-8c179573ae70 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c 1G" returned: 0 in 0.610s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e534359c-4867-451b-8834-8c179573ae70 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:12 devstack sudo[88552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c Apr 07 06:13:12 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:12 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Created reservations ['ac48c8a4-d428-4b7f-b594-9b9717e54bcc', '8a0a68a4-a973-4604-aeb2-73a81fadf179', '1291927f-7f61-4cb3-ac70-bc8cccd4a3a0', 'e9b60db6-7474-4571-b6d8-ee87b4401a37'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:13 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:13 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:13 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dd0ca5b2-0b91-45aa-a70a-c30ca5071425" returned: 0 in 0.541s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-quobyte-dd0ca5b2-0b91-45aa-a70a-c30ca5071425" released by "delete_volume" :: held 1.175s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] Created reservations ['461b1f8d-a8ae-48f6-bdeb-613f65514ced', '3f725af2-c95b-4ff9-bc72-c8fab8eea68b', '0e77da2d-04ed-4744-b754-f19e777ece80', '0142bacd-2fb5-447c-9d17-f5aa65423e9f'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:13 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:13 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:13 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.453s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:13 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Deleted volume successfully. Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fc0098e7-a70b-49bb-986a-cc27a66b7fd8 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-81a2d7cd-6c78-45f5-a1fe-807ea6d96bd2-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:13 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e534359c-4867-451b-8834-8c179573ae70 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c" returned: 0 in 0.596s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:13 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-e534359c-4867-451b-8834-8c179573ae70 tempest-VolumesDeleteCascade-1794776792 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c is being set with open permissions: ugo+rw Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e534359c-4867-451b-8834-8c179573ae70 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:13 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c Apr 07 06:13:13 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "cinder-a8b0d9ad-ef50-4990-b764-38e06afbca48-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-a8b0d9ad-ef50-4990-b764-38e06afbca48-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "cinder-quobyte-a8b0d9ad-ef50-4990-b764-38e06afbca48" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-quobyte-a8b0d9ad-ef50-4990-b764-38e06afbca48" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:13 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.544s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:13 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:13 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] Deleted volume successfully. Apr 07 06:13:14 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[522056dc-6e41-4102-a3ae-f6c1a36b2ddf]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a8b0d9ad-ef50-4990-b764-38e06afbca48 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8ece849d-0284-4a0e-9b67-2448f6e64f0e tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-dd0ca5b2-0b91-45aa-a70a-c30ca5071425-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:14 devstack sudo[88567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a8b0d9ad-ef50-4990-b764-38e06afbca48 Apr 07 06:13:14 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:14 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e534359c-4867-451b-8834-8c179573ae70 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c" returned: 0 in 0.572s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e534359c-4867-451b-8834-8c179573ae70 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:14 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.info Apr 07 06:13:14 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "cinder-61db24e8-7dd0-48ea-aa2e-991e31ed3456-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-61db24e8-7dd0-48ea-aa2e-991e31ed3456-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "cinder-quobyte-61db24e8-7dd0-48ea-aa2e-991e31ed3456" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-quobyte-61db24e8-7dd0-48ea-aa2e-991e31ed3456" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:14 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6e4c46-a44a-4088-8e97-a4f16a1d92be]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-61db24e8-7dd0-48ea-aa2e-991e31ed3456 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:14 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-61db24e8-7dd0-48ea-aa2e-991e31ed3456 Apr 07 06:13:14 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:14 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a8b0d9ad-ef50-4990-b764-38e06afbca48" returned: 0 in 0.565s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a8b0d9ad-ef50-4990-b764-38e06afbca48 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:14 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a8b0d9ad-ef50-4990-b764-38e06afbca48 Apr 07 06:13:14 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:14 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e534359c-4867-451b-8834-8c179573ae70 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.info" returned: 0 in 0.508s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:14 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-e534359c-4867-451b-8834-8c179573ae70 tempest-VolumesDeleteCascade-1794776792 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.info is being set with open permissions: ugo+rw Apr 07 06:13:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e534359c-4867-451b-8834-8c179573ae70 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:14 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.info Apr 07 06:13:14 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:14 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-61db24e8-7dd0-48ea-aa2e-991e31ed3456" returned: 0 in 0.525s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-61db24e8-7dd0-48ea-aa2e-991e31ed3456 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:14 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-61db24e8-7dd0-48ea-aa2e-991e31ed3456 Apr 07 06:13:14 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:15 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a8b0d9ad-ef50-4990-b764-38e06afbca48" returned: 0 in 0.477s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-quobyte-a8b0d9ad-ef50-4990-b764-38e06afbca48" released by "delete_volume" :: held 1.080s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Created reservations ['71b088a6-1c3e-44f9-80e4-f7db58b233a4', '175222db-a620-43e1-a237-1a017c979007', '63ee8ca9-263f-4fbf-a5da-e9ad68e704bb', '45bead3a-8b3b-4dac-8f29-2f9acdca1f62'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:15 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:15 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:15 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e534359c-4867-451b-8834-8c179573ae70 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.info" returned: 0 in 0.576s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e534359c-4867-451b-8834-8c179573ae70 tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.541s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.553s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1383140046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04901927-3ce7-489f-ac6c-a41cc88c7653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b339f8f31fa0427084bb0386f226c1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:10Z,use_quota=True,user_id='cf88251c3a1a46239e7e4f664248bcc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Creating volume 04901927-3ce7-489f-ac6c-a41cc88c7653 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:15 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-04901927-3ce7-489f-ac6c-a41cc88c7653 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:15 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-e534359c-4867-451b-8834-8c179573ae70 tempest-VolumesDeleteCascade-1794776792 None] Create snapshot completed successfully Apr 07 06:13:15 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-04901927-3ce7-489f-ac6c-a41cc88c7653 1073741824 Apr 07 06:13:15 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:15 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-61db24e8-7dd0-48ea-aa2e-991e31ed3456" returned: 0 in 0.563s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-quobyte-61db24e8-7dd0-48ea-aa2e-991e31ed3456" released by "delete_volume" :: held 1.113s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] Created reservations ['af88b0df-52c8-426b-8028-0ad695abea79', '79301c66-df18-41fd-a70a-d8ce73064a55', '47094f3c-a158-4bf0-b40b-9a0aee771d47', 'd6492e83-91dc-4fd1-85c5-bbfb8c1ce539'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:15 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:15 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:15 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.611s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:15 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Deleted volume successfully. Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Flow 'volume_create_manager' (6b3e6f7c-08d4-4de3-ad07-0ba337fa3635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31c555b-f75b-44a6-a0c8-91bb961c9067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31c555b-f75b-44a6-a0c8-91bb961c9067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1449661966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e1569d-efa4-40e9-8a85-51a4130955ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7816f2a9bddc49e594c9f7c58f22c5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5dbcfddc-ec35-45da-a5ca-417a13995a7c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:16Z,use_quota=True,user_id='8996444800db4cd2a58a9ed8a0de0ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb4daaf-68e7-4e85-b6d0-11c1851ce18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb4daaf-68e7-4e85-b6d0-11c1851ce18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4412bb8d-b101-4187-bffa-acacd5561072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4412bb8d-b101-4187-bffa-acacd5561072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd3e1569d-efa4-40e9-8a85-51a4130955ba', 'volume_name': 'volume-d3e1569d-efa4-40e9-8a85-51a4130955ba', 'volume_size': 1, 'snapshot_id': '5dbcfddc-ec35-45da-a5ca-417a13995a7c'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd49b0d4-1d31-4cdf-bc48-988adf835b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd49b0d4-1d31-4cdf-bc48-988adf835b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be20afb6-ce39-4a8c-bf75-0c6dc0517e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:15 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Volume d3e1569d-efa4-40e9-8a85-51a4130955ba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d3e1569d-efa4-40e9-8a85-51a4130955ba', 'volume_size': 1, 'snapshot_id': '5dbcfddc-ec35-45da-a5ca-417a13995a7c'} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f4fcffef-5cca-4c13-932a-d7109614fba6 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-a8b0d9ad-ef50-4990-b764-38e06afbca48-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:15 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-04901927-3ce7-489f-ac6c-a41cc88c7653 1073741824" returned: 0 in 0.647s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-04901927-3ce7-489f-ac6c-a41cc88c7653 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:15 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-04901927-3ce7-489f-ac6c-a41cc88c7653 Apr 07 06:13:15 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:16 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.484s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:16 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] Deleted volume successfully. Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-84ed61a1-e3ae-4ca0-8b57-d8bc462e7f3b tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-61db24e8-7dd0-48ea-aa2e-991e31ed3456-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "cinder-7e078ec0-aca9-4217-8621-920163c81b07-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-7e078ec0-aca9-4217-8621-920163c81b07-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "cinder-quobyte-7e078ec0-aca9-4217-8621-920163c81b07" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-quobyte-7e078ec0-aca9-4217-8621-920163c81b07" acquired by "delete_volume" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e94da64-33de-4900-96c1-edff9c91bb2a]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7e078ec0-aca9-4217-8621-920163c81b07 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:16 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7e078ec0-aca9-4217-8621-920163c81b07 Apr 07 06:13:16 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:16 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-04901927-3ce7-489f-ac6c-a41cc88c7653" returned: 0 in 0.440s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.491s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "cinder-quobyte-5dbcfddc-ec35-45da-a5ca-417a13995a7c-d3e1569d-efa4-40e9-8a85-51a4130955ba" by "_create_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e116a8b4-62d7-466e-a0ae-95539f37a87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04901927-3ce7-489f-ac6c-a41cc88c7653', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94cdb521-b68f-45d7-a0b5-c39f448a2b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:16 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Volume volume-04901927-3ce7-489f-ac6c-a41cc88c7653 (04901927-3ce7-489f-ac6c-a41cc88c7653): created successfully Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94cdb521-b68f-45d7-a0b5-c39f448a2b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Flow 'volume_create_manager' (89c78da3-1db6-4f50-b1cf-a90c163f04ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-5dbcfddc-ec35-45da-a5ca-417a13995a7c-d3e1569d-efa4-40e9-8a85-51a4130955ba" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Creating volume d3e1569d-efa4-40e9-8a85-51a4130955ba from snapshot 5dbcfddc-ec35-45da-a5ca-417a13995a7c {{(pid=82475) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "cinder-quobyte-d3e1569d-efa4-40e9-8a85-51a4130955ba" by "_copy_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:16 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-55c5fb2d-002e-415b-97fd-ad7a1ffb24a6 tempest-VolumesTransfersTest-1842231438 None] Created volume successfully. Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-d3e1569d-efa4-40e9-8a85-51a4130955ba" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] snapshot: 5dbcfddc-ec35-45da-a5ca-417a13995a7c, volume: d3e1569d-efa4-40e9-8a85-51a4130955ba, {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9b19dc-3c67-4b61-b6e8-285e26e0e2bd]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:16 devstack sudo[88605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c Apr 07 06:13:16 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "cinder-66671787-48b1-4117-babf-21883012f6a9-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-66671787-48b1-4117-babf-21883012f6a9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "cinder-quobyte-66671787-48b1-4117-babf-21883012f6a9" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-quobyte-66671787-48b1-4117-babf-21883012f6a9" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[990831b1-1c25-47a3-899b-cde2effd8206]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66671787-48b1-4117-babf-21883012f6a9 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:16 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66671787-48b1-4117-babf-21883012f6a9 Apr 07 06:13:16 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:16 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7e078ec0-aca9-4217-8621-920163c81b07" returned: 0 in 0.550s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7e078ec0-aca9-4217-8621-920163c81b07 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:16 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7e078ec0-aca9-4217-8621-920163c81b07 Apr 07 06:13:16 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:16 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c" returned: 0 in 0.512s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] will copy from snapshot at /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Creating direct copy from snapshot {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37b28db-7bc8-4d49-9a48-8a5544508790]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:17 devstack sudo[88617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d Apr 07 06:13:17 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:17 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66671787-48b1-4117-babf-21883012f6a9" returned: 0 in 0.596s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66671787-48b1-4117-babf-21883012f6a9 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:17 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7e078ec0-aca9-4217-8621-920163c81b07" returned: 0 in 0.492s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:17 devstack sudo[88623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66671787-48b1-4117-babf-21883012f6a9 Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-quobyte-7e078ec0-aca9-4217-8621-920163c81b07" released by "delete_volume" :: held 1.077s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:17 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Created reservations ['a2f11d85-f63a-48c0-93c0-af963ba4cd12', '590e12c4-e4e0-49d6-b0bb-c55fb85804b8', '0120ad1a-11eb-4a52-9fe1-aff5a6dc737e', '368cb0dd-e025-4038-99b6-062e186220b6'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:17 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:17 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:17 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d" returned: 0 in 0.624s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG cinder.utils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Path /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d3e1569d-efa4-40e9-8a85-51a4130955ba not found in is_blk_device check {{(pid=82475) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d3e1569d-efa4-40e9-8a85-51a4130955ba {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:17 devstack sudo[88630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d3e1569d-efa4-40e9-8a85-51a4130955ba Apr 07 06:13:17 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:17 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-269dd7f0-971c-4284-ba28-d8699bf3c5d4 tempest-VolumesTransfersTest-209273627 None] Transfer volume completed successfully. Apr 07 06:13:17 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66671787-48b1-4117-babf-21883012f6a9" returned: 0 in 0.496s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-quobyte-66671787-48b1-4117-babf-21883012f6a9" released by "delete_volume" :: held 1.128s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] Created reservations ['7e54010a-78af-4572-885b-66450c9e76dc', 'f1b1eac3-dd4d-488f-b174-dd071ee05856', '6586a423-b588-474a-976b-c94d2b941061', '7a2d8fe8-03ef-4dcd-8980-db17ebc2f0c5'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:17 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.541s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:17 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Deleted volume successfully. Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:17 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1ca6c26a-805f-4374-b1d8-2c5831735002 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-7e078ec0-aca9-4217-8621-920163c81b07-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:17 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:17 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:18 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.665s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:18 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:18 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] Deleted volume successfully. Apr 07 06:13:18 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4d12a45d-fb24-4b58-b8f1-47e418cc39da tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-66671787-48b1-4117-babf-21883012f6a9-delete_volume" released by "delete_volume" :: held 2.075s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:18 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "cinder-e4ba9c36-bf39-46e3-851c-c46dfc6106b3-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:18 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-e4ba9c36-bf39-46e3-851c-c46dfc6106b3-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "cinder-68161946-c2d7-4a8e-9ee6-37899c656c8d-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "cinder-quobyte-e4ba9c36-bf39-46e3-851c-c46dfc6106b3" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-68161946-c2d7-4a8e-9ee6-37899c656c8d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-quobyte-e4ba9c36-bf39-46e3-851c-c46dfc6106b3" acquired by "delete_volume" :: waited 0.045s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:19 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faa8769-13bc-4302-93e9-879c961e52c2]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e4ba9c36-bf39-46e3-851c-c46dfc6106b3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "cinder-quobyte-68161946-c2d7-4a8e-9ee6-37899c656c8d" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-quobyte-68161946-c2d7-4a8e-9ee6-37899c656c8d" acquired by "delete_volume" :: waited 0.058s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] Acquiring lock "cinder-04901927-3ce7-489f-ac6c-a41cc88c7653-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:19 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[555c8905-fc8f-4239-95d5-59c7c2b195a3]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-68161946-c2d7-4a8e-9ee6-37899c656c8d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] Lock "cinder-04901927-3ce7-489f-ac6c-a41cc88c7653-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:19 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e4ba9c36-bf39-46e3-851c-c46dfc6106b3 Apr 07 06:13:19 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] Acquiring lock "cinder-quobyte-04901927-3ce7-489f-ac6c-a41cc88c7653" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] Lock "cinder-quobyte-04901927-3ce7-489f-ac6c-a41cc88c7653" acquired by "delete_volume" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:19 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[32eda32a-7a4e-4930-b9ae-2325d24bda07]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-04901927-3ce7-489f-ac6c-a41cc88c7653 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:19 devstack sudo[88683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-68161946-c2d7-4a8e-9ee6-37899c656c8d Apr 07 06:13:19 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:19 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-04901927-3ce7-489f-ac6c-a41cc88c7653 Apr 07 06:13:19 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:20 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d3e1569d-efa4-40e9-8a85-51a4130955ba" returned: 0 in 2.918s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:20 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c851585-4380-4e81-a2d1-f8714aea1a5b]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:20 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d Apr 07 06:13:20 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:20 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-68161946-c2d7-4a8e-9ee6-37899c656c8d" returned: 0 in 1.249s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-68161946-c2d7-4a8e-9ee6-37899c656c8d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:20 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-68161946-c2d7-4a8e-9ee6-37899c656c8d Apr 07 06:13:20 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:20 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:20 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e4ba9c36-bf39-46e3-851c-c46dfc6106b3" returned: 0 in 1.610s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e4ba9c36-bf39-46e3-851c-c46dfc6106b3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-04901927-3ce7-489f-ac6c-a41cc88c7653" returned: 0 in 1.143s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-04901927-3ce7-489f-ac6c-a41cc88c7653 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:20 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e4ba9c36-bf39-46e3-851c-c46dfc6106b3 Apr 07 06:13:20 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:20 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-04901927-3ce7-489f-ac6c-a41cc88c7653 Apr 07 06:13:20 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:21 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d" returned: 0 in 0.688s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Image conversion details: src /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d, size 1024.00 MB, duration 2.92 sec, destination /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d3e1569d-efa4-40e9-8a85-51a4130955ba {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:13:21 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Converted 1024.00 MB image at 350.71 MB/s Apr 07 06:13:21 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d3e1569d-efa4-40e9-8a85-51a4130955ba is being set with open permissions: ugo+rw Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d3e1569d-efa4-40e9-8a85-51a4130955ba {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:21 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-68161946-c2d7-4a8e-9ee6-37899c656c8d" returned: 0 in 0.544s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:21 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d3e1569d-efa4-40e9-8a85-51a4130955ba Apr 07 06:13:21 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-quobyte-68161946-c2d7-4a8e-9ee6-37899c656c8d" released by "delete_volume" :: held 1.900s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:21 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-04901927-3ce7-489f-ac6c-a41cc88c7653" returned: 0 in 0.495s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] Created reservations ['ddad1615-6a12-4fb4-89e1-c29e79ab7065', 'b6733105-1273-465b-91ed-33c46979329a', '5739c24b-e96e-4081-b12b-df04b18b04c0', 'b4e49d00-1b39-4781-a30e-4450dc104ebd'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] Lock "cinder-quobyte-04901927-3ce7-489f-ac6c-a41cc88c7653" released by "delete_volume" :: held 1.705s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] Created reservations ['c3d93d2a-bf22-4dce-975a-fe76de7dcf41', '6d265804-34eb-48c5-bf8e-b764ee139226', 'f139dc5a-746a-4e4a-a99e-f14f5ab023c4', 'b5b73294-e242-48ba-9c52-4e9c6b9c4308'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:21 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:21 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:21 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e4ba9c36-bf39-46e3-851c-c46dfc6106b3" returned: 0 in 0.657s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-quobyte-e4ba9c36-bf39-46e3-851c-c46dfc6106b3" released by "delete_volume" :: held 2.346s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "cinder-ceb029af-830f-4d96-9915-acb46204f25f-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-ceb029af-830f-4d96-9915-acb46204f25f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:21 devstack sudo[88716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:21 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "cinder-quobyte-ceb029af-830f-4d96-9915-acb46204f25f" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Created reservations ['49ed9116-706f-48ee-a3c4-d081ae2397f3', 'a7b48191-96e7-417e-8982-04828fe8a4c3', '8f2138b7-6dfc-4f3f-a531-3cd512246fb0', 'e89b6d7b-f002-4de2-86bf-1edb14df667d'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-quobyte-ceb029af-830f-4d96-9915-acb46204f25f" acquired by "delete_volume" :: waited 0.021s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6a85dc-7d18-45fb-a6d3-4e4ae595fbb7]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ceb029af-830f-4d96-9915-acb46204f25f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:21 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:21 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:21 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ceb029af-830f-4d96-9915-acb46204f25f Apr 07 06:13:21 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:21 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d3e1569d-efa4-40e9-8a85-51a4130955ba" returned: 0 in 0.691s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-d3e1569d-efa4-40e9-8a85-51a4130955ba" released by "_copy_volume_from_snapshot" :: held 5.500s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-5dbcfddc-ec35-45da-a5ca-417a13995a7c-d3e1569d-efa4-40e9-8a85-51a4130955ba" released by "_create_volume_from_snapshot" :: held 5.524s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.559s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be20afb6-ce39-4a8c-bf75-0c6dc0517e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3e1569d-efa4-40e9-8a85-51a4130955ba', 'volume_size': 1, 'snapshot_id': '5dbcfddc-ec35-45da-a5ca-417a13995a7c'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06693e54-b4c4-484b-8500-b4a968de9920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:21 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Volume volume-d3e1569d-efa4-40e9-8a85-51a4130955ba (d3e1569d-efa4-40e9-8a85-51a4130955ba): created successfully Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06693e54-b4c4-484b-8500-b4a968de9920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:21 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Flow 'volume_create_manager' (6b3e6f7c-08d4-4de3-ad07-0ba337fa3635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:22 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-c188e912-2dad-45b3-9ab1-a083c2296c4b tempest-VolumesDeleteCascade-1794776792 None] Created volume successfully. Apr 07 06:13:22 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.672s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:22 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] Deleted volume successfully. Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f241edeb-9f4c-4ed2-bda0-f998d99529f5 tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-68161946-c2d7-4a8e-9ee6-37899c656c8d-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:22 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.707s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:22 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] Deleted volume successfully. Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-f9faeec4-25bf-4983-9303-cfce5f7c477b tempest-VolumesTransfersTest-521526725 None] Lock "cinder-04901927-3ce7-489f-ac6c-a41cc88c7653-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Flow 'volume_create_manager' (cf69d979-43bf-46fe-9a1f-97200f43a949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96256577-1de1-4a8b-bf67-5992576f711f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96256577-1de1-4a8b-bf67-5992576f711f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-51959495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d3ac16-7997-4e41-ad7b-f50953b6d0b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b339f8f31fa0427084bb0386f226c1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:22Z,use_quota=True,user_id='cf88251c3a1a46239e7e4f664248bcc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786584d5-1a3b-40af-9846-d63ce95dd313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:22 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786584d5-1a3b-40af-9846-d63ce95dd313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f385d2de-61dc-466b-a3d1-50ea26a756a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f385d2de-61dc-466b-a3d1-50ea26a756a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85d3ac16-7997-4e41-ad7b-f50953b6d0b1', 'volume_name': 'volume-85d3ac16-7997-4e41-ad7b-f50953b6d0b1', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f9c5087-b2ca-4f98-9bf7-879e8268bad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f9c5087-b2ca-4f98-9bf7-879e8268bad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:22 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad528b3a-d6da-4bb0-805a-c88e956c3dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:22 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Volume 85d3ac16-7997-4e41-ad7b-f50953b6d0b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85d3ac16-7997-4e41-ad7b-f50953b6d0b1', 'volume_size': 1} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-51959495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d3ac16-7997-4e41-ad7b-f50953b6d0b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b339f8f31fa0427084bb0386f226c1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:22Z,use_quota=True,user_id='cf88251c3a1a46239e7e4f664248bcc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Creating volume 85d3ac16-7997-4e41-ad7b-f50953b6d0b1 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:22 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85d3ac16-7997-4e41-ad7b-f50953b6d0b1 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.737s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ceb029af-830f-4d96-9915-acb46204f25f" returned: 0 in 0.852s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ceb029af-830f-4d96-9915-acb46204f25f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:22 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85d3ac16-7997-4e41-ad7b-f50953b6d0b1 1073741824 Apr 07 06:13:22 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:22 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Deleted volume successfully. Apr 07 06:13:22 devstack sudo[88730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ceb029af-830f-4d96-9915-acb46204f25f Apr 07 06:13:22 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-946d3add-6bae-46c1-b1f4-9a8b4983d341 tempest-CreateVolumesFromSourceVolumeTest-47259891 None] Lock "cinder-e4ba9c36-bf39-46e3-851c-c46dfc6106b3-delete_volume" released by "delete_volume" :: held 3.761s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "cinder-99fdda8a-517a-4652-8236-f7b6e74f7c8d-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-99fdda8a-517a-4652-8236-f7b6e74f7c8d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Performing cascade delete. {{(pid=82475) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "cinder-5dbcfddc-ec35-45da-a5ca-417a13995a7c-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-5dbcfddc-ec35-45da-a5ca-417a13995a7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "cinder-quobyte-99fdda8a-517a-4652-8236-f7b6e74f7c8d" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-99fdda8a-517a-4652-8236-f7b6e74f7c8d" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "cinder-quobyte-5dbcfddc-ec35-45da-a5ca-417a13995a7c" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-5dbcfddc-ec35-45da-a5ca-417a13995a7c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Deleting offline snapshot 5dbcfddc-ec35-45da-a5ca-417a13995a7c of volume 99fdda8a-517a-4652-8236-f7b6e74f7c8d {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] snapshot_file for this snap is: volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[15acbcc0-85c0-497f-8c78-392312687a20]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:22 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c Apr 07 06:13:22 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:23 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ceb029af-830f-4d96-9915-acb46204f25f" returned: 0 in 0.555s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-quobyte-ceb029af-830f-4d96-9915-acb46204f25f" released by "delete_volume" :: held 1.437s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] Created reservations ['19e9ef74-76e3-4fea-a1b7-3dc93e387b8f', '85c91cbd-4c8c-4ef7-9e05-549c703b4c0e', '906acec0-e59b-482b-b5ce-0edb9e96b47d', 'b2c79100-a486-4d38-b412-4ea94ce34cd5'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:23 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85d3ac16-7997-4e41-ad7b-f50953b6d0b1 1073741824" returned: 0 in 0.637s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85d3ac16-7997-4e41-ad7b-f50953b6d0b1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:23 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85d3ac16-7997-4e41-ad7b-f50953b6d0b1 Apr 07 06:13:23 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:23 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:23 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:23 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c" returned: 0 in 0.577s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[839ad525-36f5-447c-bfe3-43111cc03206]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:23 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d Apr 07 06:13:23 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:23 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.508s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:23 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] Deleted volume successfully. Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-8d1cd38b-f21f-4e44-a5f8-add5ceada601 tempest-CreateVolumesFromImageTest-651895446 None] Lock "cinder-ceb029af-830f-4d96-9915-acb46204f25f-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:23 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85d3ac16-7997-4e41-ad7b-f50953b6d0b1" returned: 0 in 0.624s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad528b3a-d6da-4bb0-805a-c88e956c3dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85d3ac16-7997-4e41-ad7b-f50953b6d0b1', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677c070c-4d7e-44a5-a9b0-24ea5c2ac890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:23 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Volume volume-85d3ac16-7997-4e41-ad7b-f50953b6d0b1 (85d3ac16-7997-4e41-ad7b-f50953b6d0b1): created successfully Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677c070c-4d7e-44a5-a9b0-24ea5c2ac890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Flow 'volume_create_manager' (cf69d979-43bf-46fe-9a1f-97200f43a949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:23 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-6777914d-512f-4e5a-82a9-b4fb764740b0 tempest-VolumesTransfersTest-1842231438 None] Created volume successfully. Apr 07 06:13:24 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d" returned: 0 in 0.551s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:24 devstack sudo[88753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c Apr 07 06:13:24 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:24 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c" returned: 0 in 0.544s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:24 devstack sudo[88758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c Apr 07 06:13:24 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:24 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] Acquiring lock "cinder-85d3ac16-7997-4e41-ad7b-f50953b6d0b1-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:24 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] Lock "cinder-85d3ac16-7997-4e41-ad7b-f50953b6d0b1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:24 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] Acquiring lock "cinder-quobyte-85d3ac16-7997-4e41-ad7b-f50953b6d0b1" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:24 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] Lock "cinder-quobyte-85d3ac16-7997-4e41-ad7b-f50953b6d0b1" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:24 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1c0f0c-5b80-42d4-a38e-1cab026f08ef]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85d3ac16-7997-4e41-ad7b-f50953b6d0b1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:24 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85d3ac16-7997-4e41-ad7b-f50953b6d0b1 Apr 07 06:13:24 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:25 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d.5dbcfddc-ec35-45da-a5ca-417a13995a7c" returned: 0 in 0.502s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-5dbcfddc-ec35-45da-a5ca-417a13995a7c" released by "_delete_snapshot" :: held 2.252s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-99fdda8a-517a-4652-8236-f7b6e74f7c8d" released by "delete_snapshot" :: held 2.265s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Created reservations ['c68c4eb1-c7b3-468a-a601-051ba010dfb8', '75b2acd4-ec79-4eab-8575-aedbcfb9ee7b', '3b59c9fb-2184-421c-81dc-154107a4c7fc', 'bf0bee06-ded0-47b6-acdc-3c8323d19884'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:25 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Delete snapshot completed successfully. Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-5dbcfddc-ec35-45da-a5ca-417a13995a7c-delete_snapshot" released by "delete_snapshot" :: held 2.390s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Snapshots deleted, issuing volume delete {{(pid=82475) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "cinder-quobyte-99fdda8a-517a-4652-8236-f7b6e74f7c8d" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-99fdda8a-517a-4652-8236-f7b6e74f7c8d" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d21c278-d09f-4943-821c-904135bfdb2f]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:25 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d Apr 07 06:13:25 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:25 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85d3ac16-7997-4e41-ad7b-f50953b6d0b1" returned: 0 in 0.579s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85d3ac16-7997-4e41-ad7b-f50953b6d0b1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:25 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85d3ac16-7997-4e41-ad7b-f50953b6d0b1 Apr 07 06:13:25 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Flow 'volume_create_manager' (3e41e08c-6617-4e07-916a-f59d0b7c2d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3fb8d5f-3dbd-45a3-abe4-4733249ef522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3fb8d5f-3dbd-45a3-abe4-4733249ef522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1665000087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85b9c20-9949-47ad-9b62-f1b2ee0b2167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a074a72fce415aab6c0e0adf0fdabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:26Z,use_quota=True,user_id='2bc1995c244f479b8a4d39cf039f60aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c349b1-ca30-4548-8c93-c4f5b8fc276a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c349b1-ca30-4548-8c93-c4f5b8fc276a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79c327f-160d-4cab-8075-f45a2eaf4d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79c327f-160d-4cab-8075-f45a2eaf4d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b85b9c20-9949-47ad-9b62-f1b2ee0b2167', 'volume_name': 'volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f823ce81-2168-48e5-90f9-9dc7045e24c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f823ce81-2168-48e5-90f9-9dc7045e24c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:25 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929d0b56-e599-46ea-991f-6abab1d0375e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:25 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Volume b85b9c20-9949-47ad-9b62-f1b2ee0b2167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167', 'volume_size': 1} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1665000087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85b9c20-9949-47ad-9b62-f1b2ee0b2167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a074a72fce415aab6c0e0adf0fdabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:26Z,use_quota=True,user_id='2bc1995c244f479b8a4d39cf039f60aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Creating volume b85b9c20-9949-47ad-9b62-f1b2ee0b2167 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:25 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d" returned: 0 in 0.605s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:25 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 1073741824 Apr 07 06:13:25 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:25 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d Apr 07 06:13:25 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:26 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-85d3ac16-7997-4e41-ad7b-f50953b6d0b1" returned: 0 in 0.614s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] Lock "cinder-quobyte-85d3ac16-7997-4e41-ad7b-f50953b6d0b1" released by "delete_volume" :: held 1.219s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] Created reservations ['5f0b7e80-d431-483c-ab14-82bee400922e', '0777ff39-28dc-4a64-8d2e-6b6976a9fc6d', 'f09247a2-31f2-4812-a034-37ce319372c9', '58bf841d-e2db-47d8-8b53-e195a711ff98'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:26 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:26 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:26 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-99fdda8a-517a-4652-8236-f7b6e74f7c8d" returned: 0 in 0.553s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-99fdda8a-517a-4652-8236-f7b6e74f7c8d" released by "delete_volume" :: held 1.193s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:26 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 1073741824" returned: 0 in 0.610s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Created reservations ['71b55056-28b4-4c84-a97c-5915a85540f3', 'fec77fa1-482a-4d92-8e17-3344b126e148', '9925a962-43b4-4acb-af0c-fb03ec1f3819', 'd8cbee1a-f939-4614-8c0d-bba6b6897434'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:26 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 Apr 07 06:13:26 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:26 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:26 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:26 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.545s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:26 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] Deleted volume successfully. Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-77d54345-ffa8-4c41-8c55-de2fbd0a335c tempest-VolumesTransfersTest-521526725 None] Lock "cinder-85d3ac16-7997-4e41-ad7b-f50953b6d0b1-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:26 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167" returned: 0 in 0.514s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929d0b56-e599-46ea-991f-6abab1d0375e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2f9646-6af7-42c8-a340-e1e37262ff11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:27 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Volume volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 (b85b9c20-9949-47ad-9b62-f1b2ee0b2167): created successfully Apr 07 06:13:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2f9646-6af7-42c8-a340-e1e37262ff11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Flow 'volume_create_manager' (3e41e08c-6617-4e07-916a-f59d0b7c2d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:27 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-3100fd56-ccdf-49a7-929b-84edd4b47621 tempest-VolumeDependencyTests-1445952737 None] Created volume successfully. Apr 07 06:13:27 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.574s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:27 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:27 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Deleted volume successfully. Apr 07 06:13:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-bd96d778-03ba-4733-bf72-8c57b6d00650 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-99fdda8a-517a-4652-8236-f7b6e74f7c8d-delete_volume" released by "delete_volume" :: held 4.418s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "cinder-d3e1569d-efa4-40e9-8a85-51a4130955ba-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-d3e1569d-efa4-40e9-8a85-51a4130955ba-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "cinder-quobyte-d3e1569d-efa4-40e9-8a85-51a4130955ba" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-d3e1569d-efa4-40e9-8a85-51a4130955ba" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:27 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6f0f00-77e9-46e5-a01d-dd63c6063703]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d3e1569d-efa4-40e9-8a85-51a4130955ba {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:27 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d3e1569d-efa4-40e9-8a85-51a4130955ba Apr 07 06:13:27 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-5832289b-7457-4496-9c42-45bd27b911fb tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-5832289b-7457-4496-9c42-45bd27b911fb tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:28 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-5832289b-7457-4496-9c42-45bd27b911fb tempest-VolumeDependencyTests-1445952737 None] Creating offline snapshot e2c6aead-994a-4376-b651-8efaacf34e59 of volume b85b9c20-9949-47ad-9b62-f1b2ee0b2167 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:13:28 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[868917db-092c-4c01-840d-d1e7d996b8c5]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5832289b-7457-4496-9c42-45bd27b911fb tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:28 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 Apr 07 06:13:28 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:28 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d3e1569d-efa4-40e9-8a85-51a4130955ba" returned: 0 in 0.613s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d3e1569d-efa4-40e9-8a85-51a4130955ba {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:28 devstack sudo[88798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d3e1569d-efa4-40e9-8a85-51a4130955ba Apr 07 06:13:28 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:28 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5832289b-7457-4496-9c42-45bd27b911fb tempest-VolumeDependencyTests-1445952737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167" returned: 0 in 0.671s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5832289b-7457-4496-9c42-45bd27b911fb tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:28 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59 1G Apr 07 06:13:28 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:28 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d3e1569d-efa4-40e9-8a85-51a4130955ba" returned: 0 in 0.583s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:28 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-quobyte-d3e1569d-efa4-40e9-8a85-51a4130955ba" released by "delete_volume" :: held 1.223s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:28 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] Created reservations ['a87a53ad-5fac-4ab8-bc37-2de48854986e', '75e7e07d-adc4-4937-8de1-a82ffb0af6e2', 'd3a10c9b-af28-4576-8e13-288ec55f14be', '9e861ba9-1469-43e0-a8b2-d75a2e4c0397'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:28 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:28 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:28 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:28 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:29 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.498s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:29 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:29 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] Deleted volume successfully. Apr 07 06:13:29 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1eee42a7-0d3d-403d-9f80-5302502a9169 tempest-VolumesDeleteCascade-1794776792 None] Lock "cinder-d3e1569d-efa4-40e9-8a85-51a4130955ba-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:29 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5832289b-7457-4496-9c42-45bd27b911fb tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59 1G" returned: 0 in 0.674s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5832289b-7457-4496-9c42-45bd27b911fb tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:29 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59 Apr 07 06:13:29 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:29 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5832289b-7457-4496-9c42-45bd27b911fb tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59" returned: 0 in 0.578s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:29 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-5832289b-7457-4496-9c42-45bd27b911fb tempest-VolumeDependencyTests-1445952737 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59 is being set with open permissions: ugo+rw Apr 07 06:13:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5832289b-7457-4496-9c42-45bd27b911fb tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:30 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59 Apr 07 06:13:30 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:30 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5832289b-7457-4496-9c42-45bd27b911fb tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59" returned: 0 in 0.484s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5832289b-7457-4496-9c42-45bd27b911fb tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:30 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.info Apr 07 06:13:30 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:31 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5832289b-7457-4496-9c42-45bd27b911fb tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.info" returned: 0 in 0.550s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:31 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-5832289b-7457-4496-9c42-45bd27b911fb tempest-VolumeDependencyTests-1445952737 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.info is being set with open permissions: ugo+rw Apr 07 06:13:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5832289b-7457-4496-9c42-45bd27b911fb tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:31 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.info Apr 07 06:13:31 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:31 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5832289b-7457-4496-9c42-45bd27b911fb tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.info" returned: 0 in 0.540s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-5832289b-7457-4496-9c42-45bd27b911fb tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.582s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:31 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-5832289b-7457-4496-9c42-45bd27b911fb tempest-VolumeDependencyTests-1445952737 None] Create snapshot completed successfully Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Flow 'volume_create_manager' (48b4b44d-74e9-4562-8ae3-1f9362325811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e243e5-689d-4475-a22b-246758264758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e243e5-689d-4475-a22b-246758264758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-962293446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11636313-9019-4382-b7b6-da0bbafda256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713c4489bed049b68f9645465b0cb556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:32Z,use_quota=True,user_id='b185ba5c9ec849a49bca5eaf7fd98b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe93735-832b-4202-9073-f0e539667e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe93735-832b-4202-9073-f0e539667e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e48ccf3-aa7e-4c4b-96aa-1a443dd00e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e48ccf3-aa7e-4c4b-96aa-1a443dd00e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11636313-9019-4382-b7b6-da0bbafda256', 'volume_name': 'volume-11636313-9019-4382-b7b6-da0bbafda256', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b26f27-4fd1-4a6b-97c6-0f803444d83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b26f27-4fd1-4a6b-97c6-0f803444d83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb3ff8e-58f3-49e6-9951-88ae5dbae819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:32 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Volume 11636313-9019-4382-b7b6-da0bbafda256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11636313-9019-4382-b7b6-da0bbafda256', 'volume_size': 1} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-962293446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11636313-9019-4382-b7b6-da0bbafda256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713c4489bed049b68f9645465b0cb556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:32Z,use_quota=True,user_id='b185ba5c9ec849a49bca5eaf7fd98b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Creating volume 11636313-9019-4382-b7b6-da0bbafda256 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:32 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-11636313-9019-4382-b7b6-da0bbafda256 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:32 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-11636313-9019-4382-b7b6-da0bbafda256 1073741824 Apr 07 06:13:32 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Flow 'volume_create_manager' (c62380d9-9122-43c6-8a32-c753321aaefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (310c181a-a77d-4906-9ff0-34812e1c56ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (310c181a-a77d-4906-9ff0-34812e1c56ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1582697049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a61b785-159c-43ab-9e7b-489ad7312a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a448ef9b9e2454c8a62d09b255b8bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:32Z,use_quota=True,user_id='bb91a9d3968f466bb1e6e1ae2a17a29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c20e48a-778e-4ed7-8274-f1e905596c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c20e48a-778e-4ed7-8274-f1e905596c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22bd0b46-c6a6-49cf-a39a-405b21befbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22bd0b46-c6a6-49cf-a39a-405b21befbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a61b785-159c-43ab-9e7b-489ad7312a72', 'volume_name': 'volume-1a61b785-159c-43ab-9e7b-489ad7312a72', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa17d66-6156-4b70-af66-b72332882edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa17d66-6156-4b70-af66-b72332882edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43547adf-3c9f-42f1-b415-1b5263c1c301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:32 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Volume 1a61b785-159c-43ab-9e7b-489ad7312a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a61b785-159c-43ab-9e7b-489ad7312a72', 'volume_size': 1} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Flow 'volume_create_manager' (0af03f95-f871-4bca-a8a6-707d82d83dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da2b3b4-1a9f-4a8d-9164-a4439d741f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da2b3b4-1a9f-4a8d-9164-a4439d741f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-41101498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec88290a-35ec-4209-a67a-d291452079ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a074a72fce415aab6c0e0adf0fdabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e2c6aead-994a-4376-b651-8efaacf34e59,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:33Z,use_quota=True,user_id='2bc1995c244f479b8a4d39cf039f60aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e493f00c-679c-4697-a4e7-9262d13db216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e493f00c-679c-4697-a4e7-9262d13db216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafa149e-61de-4abb-8a73-a6ff30bab827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafa149e-61de-4abb-8a73-a6ff30bab827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ec88290a-35ec-4209-a67a-d291452079ba', 'volume_name': 'volume-ec88290a-35ec-4209-a67a-d291452079ba', 'volume_size': 1, 'snapshot_id': 'e2c6aead-994a-4376-b651-8efaacf34e59'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cba2ecb-d5da-406f-9753-4055ffe8d4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cba2ecb-d5da-406f-9753-4055ffe8d4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (324cb8b6-5b84-4672-8abf-425bd656b855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:32 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Volume ec88290a-35ec-4209-a67a-d291452079ba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ec88290a-35ec-4209-a67a-d291452079ba', 'volume_size': 1, 'snapshot_id': 'e2c6aead-994a-4376-b651-8efaacf34e59'} Apr 07 06:13:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:33 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-11636313-9019-4382-b7b6-da0bbafda256 1073741824" returned: 0 in 0.545s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-11636313-9019-4382-b7b6-da0bbafda256 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:33 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-11636313-9019-4382-b7b6-da0bbafda256 Apr 07 06:13:33 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:33 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-11636313-9019-4382-b7b6-da0bbafda256" returned: 0 in 0.417s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:33 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.875s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:33 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1582697049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a61b785-159c-43ab-9e7b-489ad7312a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a448ef9b9e2454c8a62d09b255b8bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:32Z,use_quota=True,user_id='bb91a9d3968f466bb1e6e1ae2a17a29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:33 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Creating volume 1a61b785-159c-43ab-9e7b-489ad7312a72 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:33 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:33 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:33 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:33 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:13:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1a61b785-159c-43ab-9e7b-489ad7312a72 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:33 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb3ff8e-58f3-49e6-9951-88ae5dbae819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11636313-9019-4382-b7b6-da0bbafda256', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:33 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1a61b785-159c-43ab-9e7b-489ad7312a72 1073741824 Apr 07 06:13:33 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:33 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1759df8-9c9b-4f26-b96b-f6460d26d3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:33 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Volume volume-11636313-9019-4382-b7b6-da0bbafda256 (11636313-9019-4382-b7b6-da0bbafda256): created successfully Apr 07 06:13:33 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1759df8-9c9b-4f26-b96b-f6460d26d3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:33 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Flow 'volume_create_manager' (48b4b44d-74e9-4562-8ae3-1f9362325811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:33 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-c41b129b-88ae-490f-a033-50b50eb00fd7 tempest-VolumesTransfersV355Test-1605501268 None] Created volume successfully. Apr 07 06:13:34 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1a61b785-159c-43ab-9e7b-489ad7312a72 1073741824" returned: 0 in 0.493s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1a61b785-159c-43ab-9e7b-489ad7312a72 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:34 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1a61b785-159c-43ab-9e7b-489ad7312a72 Apr 07 06:13:34 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:34 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1a61b785-159c-43ab-9e7b-489ad7312a72" returned: 0 in 0.385s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.535s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "cinder-quobyte-e2c6aead-994a-4376-b651-8efaacf34e59-ec88290a-35ec-4209-a67a-d291452079ba" by "_create_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43547adf-3c9f-42f1-b415-1b5263c1c301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a61b785-159c-43ab-9e7b-489ad7312a72', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee23958-c84c-4ba5-b87a-66ddbb59fbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:34 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Volume volume-1a61b785-159c-43ab-9e7b-489ad7312a72 (1a61b785-159c-43ab-9e7b-489ad7312a72): created successfully Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee23958-c84c-4ba5-b87a-66ddbb59fbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Flow 'volume_create_manager' (c62380d9-9122-43c6-8a32-c753321aaefc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-e2c6aead-994a-4376-b651-8efaacf34e59-ec88290a-35ec-4209-a67a-d291452079ba" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Creating volume ec88290a-35ec-4209-a67a-d291452079ba from snapshot e2c6aead-994a-4376-b651-8efaacf34e59 {{(pid=82475) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "cinder-quobyte-ec88290a-35ec-4209-a67a-d291452079ba" by "_copy_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:34 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-a05f2994-34f4-431c-b24d-e8dcd24d6f6c tempest-VolumesMetadataTest-1913801497 None] Created volume successfully. Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-ec88290a-35ec-4209-a67a-d291452079ba" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] snapshot: e2c6aead-994a-4376-b651-8efaacf34e59, volume: ec88290a-35ec-4209-a67a-d291452079ba, {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[67428b3f-32a7-412c-a0b2-70c63745325e]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:34 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59 Apr 07 06:13:34 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:34 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-984326a2-d45a-4b3c-85bf-d0f918283874 tempest-VolumesTransfersV355Test-2043045162 None] Transfer volume completed successfully. Apr 07 06:13:35 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59" returned: 0 in 0.609s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] will copy from snapshot at /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Creating direct copy from snapshot {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9a18f7-68ae-4d07-9375-67c809a3ce7c]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:35 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 Apr 07 06:13:35 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] Acquiring lock "cinder-1a61b785-159c-43ab-9e7b-489ad7312a72-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] Lock "cinder-1a61b785-159c-43ab-9e7b-489ad7312a72-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] Acquiring lock "cinder-quobyte-1a61b785-159c-43ab-9e7b-489ad7312a72" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] Lock "cinder-quobyte-1a61b785-159c-43ab-9e7b-489ad7312a72" acquired by "delete_volume" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12f8e9f-70a1-40ac-8300-edd8a6407f7d]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1a61b785-159c-43ab-9e7b-489ad7312a72 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:35 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1a61b785-159c-43ab-9e7b-489ad7312a72 Apr 07 06:13:35 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:35 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167" returned: 0 in 0.603s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG cinder.utils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Path /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ec88290a-35ec-4209-a67a-d291452079ba not found in is_blk_device check {{(pid=82475) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ec88290a-35ec-4209-a67a-d291452079ba {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:35 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ec88290a-35ec-4209-a67a-d291452079ba Apr 07 06:13:35 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] Acquiring lock "cinder-11636313-9019-4382-b7b6-da0bbafda256-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] Lock "cinder-11636313-9019-4382-b7b6-da0bbafda256-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] Acquiring lock "cinder-quobyte-11636313-9019-4382-b7b6-da0bbafda256" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] Lock "cinder-quobyte-11636313-9019-4382-b7b6-da0bbafda256" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:35 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1a61b785-159c-43ab-9e7b-489ad7312a72" returned: 0 in 0.542s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1a61b785-159c-43ab-9e7b-489ad7312a72 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[031773df-331e-47d8-8c09-4699cc7b0ce7]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-11636313-9019-4382-b7b6-da0bbafda256 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:35 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1a61b785-159c-43ab-9e7b-489ad7312a72 Apr 07 06:13:35 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:35 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-11636313-9019-4382-b7b6-da0bbafda256 Apr 07 06:13:35 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:36 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-1a61b785-159c-43ab-9e7b-489ad7312a72" returned: 0 in 0.911s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:36 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] Lock "cinder-quobyte-1a61b785-159c-43ab-9e7b-489ad7312a72" released by "delete_volume" :: held 1.478s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:36 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] Created reservations ['9841d230-81d4-4e3f-a8d1-5ec074373b52', '22945589-e411-4636-9629-3a213fab6319', '8d61f7f1-be4e-40c0-b999-848043fbb8c9', '9c21ff90-461b-423a-a541-a1d773aa4839'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:37 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-11636313-9019-4382-b7b6-da0bbafda256" returned: 0 in 1.303s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-11636313-9019-4382-b7b6-da0bbafda256 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:37 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:37 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:37 devstack sudo[88879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-11636313-9019-4382-b7b6-da0bbafda256 Apr 07 06:13:37 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:37 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:37 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:38 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ec88290a-35ec-4209-a67a-d291452079ba" returned: 0 in 2.498s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:38 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5f5da5-56ff-4233-b81e-3882f0c1ce3a]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:38 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 Apr 07 06:13:38 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:38 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-11636313-9019-4382-b7b6-da0bbafda256" returned: 0 in 1.208s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:38 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] Lock "cinder-quobyte-11636313-9019-4382-b7b6-da0bbafda256" released by "delete_volume" :: held 2.548s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:38 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] Created reservations ['5c604aec-2417-4acb-bf33-d146166d1657', '342023ff-ed2e-4db4-86b7-67f4e0ed7c7b', 'b79c0f68-51a7-46a4-9b55-c8e17a5bfde9', '39e16683-5584-4c46-9274-b1c54fa8b32f'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:38 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 1.196s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:38 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:38 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] Deleted volume successfully. Apr 07 06:13:38 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-e770e06f-b41f-4453-8276-ec5e09e614b7 tempest-VolumesMetadataTest-1913801497 None] Lock "cinder-1a61b785-159c-43ab-9e7b-489ad7312a72-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:38 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:38 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:38 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167" returned: 0 in 0.717s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:38 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Image conversion details: src /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167, size 1024.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ec88290a-35ec-4209-a67a-d291452079ba {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:13:38 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Converted 1024.00 MB image at 409.70 MB/s Apr 07 06:13:38 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ec88290a-35ec-4209-a67a-d291452079ba is being set with open permissions: ugo+rw Apr 07 06:13:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ec88290a-35ec-4209-a67a-d291452079ba {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:38 devstack sudo[88893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ec88290a-35ec-4209-a67a-d291452079ba Apr 07 06:13:38 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:39 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.478s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:39 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] Deleted volume successfully. Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-66cb56c2-d1aa-4122-928b-14c4f0f40061 tempest-VolumesTransfersV355Test-91825088 None] Lock "cinder-11636313-9019-4382-b7b6-da0bbafda256-delete_volume" released by "delete_volume" :: held 3.176s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:39 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ec88290a-35ec-4209-a67a-d291452079ba" returned: 0 in 0.527s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-ec88290a-35ec-4209-a67a-d291452079ba" released by "_copy_volume_from_snapshot" :: held 5.022s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-e2c6aead-994a-4376-b651-8efaacf34e59-ec88290a-35ec-4209-a67a-d291452079ba" released by "_create_volume_from_snapshot" :: held 5.045s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.087s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (324cb8b6-5b84-4672-8abf-425bd656b855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec88290a-35ec-4209-a67a-d291452079ba', 'volume_size': 1, 'snapshot_id': 'e2c6aead-994a-4376-b651-8efaacf34e59'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf4310b-cb66-4311-aef9-720863ec216b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:39 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Volume volume-ec88290a-35ec-4209-a67a-d291452079ba (ec88290a-35ec-4209-a67a-d291452079ba): created successfully Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf4310b-cb66-4311-aef9-720863ec216b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Flow 'volume_create_manager' (0af03f95-f871-4bca-a8a6-707d82d83dfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:39 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-49c9de0c-35da-4600-a62b-fdee1ab977dc tempest-VolumeDependencyTests-1445952737 None] Created volume successfully. Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Flow 'volume_create_manager' (cc6d52e4-a611-46f4-b4b6-b681b90cc8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e944e66f-0032-42e5-8c83-d325f2e7187e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e944e66f-0032-42e5-8c83-d325f2e7187e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-323726123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e322d93a-fa01-4f62-ada5-97aeb3efce9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713c4489bed049b68f9645465b0cb556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:40Z,use_quota=True,user_id='b185ba5c9ec849a49bca5eaf7fd98b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21435508-ba19-4888-8e20-31a85be8135e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21435508-ba19-4888-8e20-31a85be8135e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4cfaba-b894-47ee-8f91-62aa3137b278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4cfaba-b894-47ee-8f91-62aa3137b278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e322d93a-fa01-4f62-ada5-97aeb3efce9b', 'volume_name': 'volume-e322d93a-fa01-4f62-ada5-97aeb3efce9b', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fa684b-e93f-43b8-a9d4-7e2e5d7bd399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fa684b-e93f-43b8-a9d4-7e2e5d7bd399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d19802-0841-4b4e-b47e-20841399a17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:39 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Volume e322d93a-fa01-4f62-ada5-97aeb3efce9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e322d93a-fa01-4f62-ada5-97aeb3efce9b', 'volume_size': 1} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-323726123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e322d93a-fa01-4f62-ada5-97aeb3efce9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713c4489bed049b68f9645465b0cb556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:40Z,use_quota=True,user_id='b185ba5c9ec849a49bca5eaf7fd98b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Creating volume e322d93a-fa01-4f62-ada5-97aeb3efce9b {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:39 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:13:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e322d93a-fa01-4f62-ada5-97aeb3efce9b 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:39 devstack sudo[88897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e322d93a-fa01-4f62-ada5-97aeb3efce9b 1073741824 Apr 07 06:13:39 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Flow 'volume_create_manager' (ea0a575b-8551-49aa-a59e-bb8118681b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3784dda-26d3-40ab-ab02-7b1f5bbf21bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3784dda-26d3-40ab-ab02-7b1f5bbf21bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1420826533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=009c3442-9cbc-4448-b8d3-7ee8bf707cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4f107f30a14aff9d6f75767ef60d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:40Z,use_quota=True,user_id='8613b189d8a247e3aa9cce681dd25bfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f4a5e4-0e19-4dc5-9a36-f88627dd0690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f4a5e4-0e19-4dc5-9a36-f88627dd0690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2670ea4a-38ab-49f7-9e51-0fcd0895c9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2670ea4a-38ab-49f7-9e51-0fcd0895c9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '009c3442-9cbc-4448-b8d3-7ee8bf707cb5', 'volume_name': 'volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cfa434-61d5-443b-821f-1cca586715fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cfa434-61d5-443b-821f-1cca586715fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7283d9-baea-4fcc-9bb4-a20783e143ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:40 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Volume 009c3442-9cbc-4448-b8d3-7ee8bf707cb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5', 'volume_size': 1} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:40 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e322d93a-fa01-4f62-ada5-97aeb3efce9b 1073741824" returned: 0 in 0.516s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e322d93a-fa01-4f62-ada5-97aeb3efce9b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:40 devstack sudo[88902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e322d93a-fa01-4f62-ada5-97aeb3efce9b Apr 07 06:13:40 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "cinder-e2c6aead-994a-4376-b651-8efaacf34e59-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-e2c6aead-994a-4376-b651-8efaacf34e59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "cinder-quobyte-b85b9c20-9949-47ad-9b62-f1b2ee0b2167" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-b85b9c20-9949-47ad-9b62-f1b2ee0b2167" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "cinder-quobyte-e2c6aead-994a-4376-b651-8efaacf34e59" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-e2c6aead-994a-4376-b651-8efaacf34e59" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] Deleting offline snapshot e2c6aead-994a-4376-b651-8efaacf34e59 of volume b85b9c20-9949-47ad-9b62-f1b2ee0b2167 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] snapshot_file for this snap is: volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa001c6-3833-4115-84f0-a6f45b7f499c]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:40 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59 Apr 07 06:13:40 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:40 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e322d93a-fa01-4f62-ada5-97aeb3efce9b" returned: 0 in 0.417s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.493s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1420826533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=009c3442-9cbc-4448-b8d3-7ee8bf707cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4f107f30a14aff9d6f75767ef60d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:40Z,use_quota=True,user_id='8613b189d8a247e3aa9cce681dd25bfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Creating volume 009c3442-9cbc-4448-b8d3-7ee8bf707cb5 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:40 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d19802-0841-4b4e-b47e-20841399a17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e322d93a-fa01-4f62-ada5-97aeb3efce9b', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:40 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 1073741824 Apr 07 06:13:40 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba3c935-b374-4b8b-9d4d-ab262aeab325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:40 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Volume volume-e322d93a-fa01-4f62-ada5-97aeb3efce9b (e322d93a-fa01-4f62-ada5-97aeb3efce9b): created successfully Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba3c935-b374-4b8b-9d4d-ab262aeab325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Flow 'volume_create_manager' (cc6d52e4-a611-46f4-b4b6-b681b90cc8c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:40 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-1be6dd48-bfa5-4b29-8ec5-91194e6b146d tempest-VolumesTransfersV355Test-1605501268 None] Created volume successfully. Apr 07 06:13:40 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59" returned: 0 in 0.493s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc166d9f-7d47-4dd5-88a3-d5f984225381]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:41 devstack sudo[88915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 Apr 07 06:13:41 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:41 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 1073741824" returned: 0 in 0.495s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:41 devstack sudo[88917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 Apr 07 06:13:41 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:41 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167" returned: 0 in 0.562s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:41 devstack sudo[88923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59 Apr 07 06:13:41 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:41 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5" returned: 0 in 0.494s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7283d9-baea-4fcc-9bb4-a20783e143ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab48d30-0476-4a13-951d-9ece7280fa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:41 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Volume volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 (009c3442-9cbc-4448-b8d3-7ee8bf707cb5): created successfully Apr 07 06:13:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab48d30-0476-4a13-951d-9ece7280fa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Flow 'volume_create_manager' (ea0a575b-8551-49aa-a59e-bb8118681b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:41 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-09d4e3de-84ad-4072-ae39-62f318d6932c tempest-VolumesCloneTest-7396751 None] Created volume successfully. Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] Acquiring lock "cinder-e322d93a-fa01-4f62-ada5-97aeb3efce9b-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] Lock "cinder-e322d93a-fa01-4f62-ada5-97aeb3efce9b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] Acquiring lock "cinder-quobyte-e322d93a-fa01-4f62-ada5-97aeb3efce9b" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] Lock "cinder-quobyte-e322d93a-fa01-4f62-ada5-97aeb3efce9b" acquired by "delete_volume" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef381cdb-9827-4a00-969e-ac9635e2fc23]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e322d93a-fa01-4f62-ada5-97aeb3efce9b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:42 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e322d93a-fa01-4f62-ada5-97aeb3efce9b Apr 07 06:13:42 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:42 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59" returned: 0 in 0.739s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:42 devstack sudo[88930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59 Apr 07 06:13:42 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Flow 'volume_create_manager' (59475c57-90fb-4feb-8297-9458ac36dea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7b936b-45be-4a6a-845a-2a8fa72668c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7b936b-45be-4a6a-845a-2a8fa72668c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-242380712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56473fb1-7c6f-495d-a188-c8875ee95dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4f107f30a14aff9d6f75767ef60d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=009c3442-9cbc-4448-b8d3-7ee8bf707cb5,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:43Z,use_quota=True,user_id='8613b189d8a247e3aa9cce681dd25bfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdc098d-fec7-452c-b3f1-1e54c53c178d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdc098d-fec7-452c-b3f1-1e54c53c178d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce9ceea-fb12-4e4c-8858-51b1425b552e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce9ceea-fb12-4e4c-8858-51b1425b552e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '56473fb1-7c6f-495d-a188-c8875ee95dbd', 'volume_name': 'volume-56473fb1-7c6f-495d-a188-c8875ee95dbd', 'volume_size': 2, 'source_volid': '009c3442-9cbc-4448-b8d3-7ee8bf707cb5', 'source_volstatus': 'available'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37facb78-672e-4080-9996-a744d7f665e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37facb78-672e-4080-9996-a744d7f665e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bbe1f18-fae0-4e9f-a6f8-47fa6d0d6fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:42 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Volume 56473fb1-7c6f-495d-a188-c8875ee95dbd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-56473fb1-7c6f-495d-a188-c8875ee95dbd', 'volume_size': 2, 'source_volid': '009c3442-9cbc-4448-b8d3-7ee8bf707cb5', 'source_volstatus': 'available'} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:42 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Cloning volume 009c3442-9cbc-4448-b8d3-7ee8bf707cb5 to volume 56473fb1-7c6f-495d-a188-c8875ee95dbd Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Creating offline snapshot 7e40b136-df1f-47a0-aa31-bca3a22cbf31 of volume 009c3442-9cbc-4448-b8d3-7ee8bf707cb5 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c35ae5-1d8a-4ec9-acba-2187091d114e]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:42 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e322d93a-fa01-4f62-ada5-97aeb3efce9b" returned: 0 in 0.745s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e322d93a-fa01-4f62-ada5-97aeb3efce9b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:42 devstack sudo[88935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 Apr 07 06:13:42 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:42 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e322d93a-fa01-4f62-ada5-97aeb3efce9b Apr 07 06:13:42 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:42 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167.e2c6aead-994a-4376-b651-8efaacf34e59" returned: 0 in 0.671s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:42 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-e2c6aead-994a-4376-b651-8efaacf34e59" released by "_delete_snapshot" :: held 2.524s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-b85b9c20-9949-47ad-9b62-f1b2ee0b2167" released by "delete_snapshot" :: held 2.539s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] Created reservations ['b9cb5026-35e8-4dd5-bc2e-34e3f8aa5a66', 'f570a7c5-5a1c-43f7-ae6a-0bc194740e0c', 'b6569703-aa64-459b-8a29-c642629d39e9', '10cc5d9f-0d86-4cb4-af2f-a81f052c9851'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:43 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] Delete snapshot completed successfully. Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65835dc2-0d28-420e-a328-cce8a108ac92 tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-e2c6aead-994a-4376-b651-8efaacf34e59-delete_snapshot" released by "delete_snapshot" :: held 2.632s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:43 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5" returned: 0 in 0.499s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:43 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e322d93a-fa01-4f62-ada5-97aeb3efce9b" returned: 0 in 0.439s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:43 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31 1G Apr 07 06:13:43 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] Lock "cinder-quobyte-e322d93a-fa01-4f62-ada5-97aeb3efce9b" released by "delete_volume" :: held 1.217s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] Created reservations ['42b4efe0-21b4-49de-9328-7dbe2a5a2dda', '2b4c2ad7-4566-4887-84a5-aa1b9b2bbebe', '1f4d4283-1ff6-445f-b3b4-d1a46c224717', 'b562e23d-7d21-4d5a-834d-5141c6137d39'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:43 devstack sudo[88946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:43 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "cinder-b85b9c20-9949-47ad-9b62-f1b2ee0b2167-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-b85b9c20-9949-47ad-9b62-f1b2ee0b2167-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "cinder-quobyte-b85b9c20-9949-47ad-9b62-f1b2ee0b2167" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-b85b9c20-9949-47ad-9b62-f1b2ee0b2167" acquired by "delete_volume" :: waited 0.026s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dae7bf6-3b06-493a-a932-af94b95ad538]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:43 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 Apr 07 06:13:43 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:43 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31 1G" returned: 0 in 0.523s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:43 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:43 devstack sudo[88954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31 Apr 07 06:13:43 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.453s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:43 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] Deleted volume successfully. Apr 07 06:13:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-762a1218-6218-41e3-a87f-6e0cf1f26ab9 tempest-VolumesTransfersV355Test-91825088 None] Lock "cinder-e322d93a-fa01-4f62-ada5-97aeb3efce9b-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:44 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167" returned: 0 in 0.569s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:44 devstack sudo[88962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167 Apr 07 06:13:44 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:44 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31" returned: 0 in 0.535s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:44 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31 is being set with open permissions: ugo+rw Apr 07 06:13:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:44 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31 Apr 07 06:13:44 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:44 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31" returned: 0 in 0.481s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:44 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b85b9c20-9949-47ad-9b62-f1b2ee0b2167" returned: 0 in 0.566s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:44 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-b85b9c20-9949-47ad-9b62-f1b2ee0b2167" released by "delete_volume" :: held 1.164s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:44 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.info Apr 07 06:13:44 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:44 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] Created reservations ['5bc1a616-4a0a-4d45-96b6-2c7cec969ff7', 'bb7b976a-2577-4387-970c-e5cdc82986df', 'cd8274bc-5de5-436c-a0eb-7b8aa13066f7', '0c25b52c-9c2b-4d0a-8baa-8ff9397e73d3'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:44 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:45 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:45 devstack sudo[88970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:45 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:45 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.info" returned: 0 in 0.434s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:45 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.info is being set with open permissions: ugo+rw Apr 07 06:13:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:45 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.info Apr 07 06:13:45 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:45 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.421s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:45 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:45 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] Deleted volume successfully. Apr 07 06:13:45 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-668eac73-443f-4fcc-88e0-e4d1cfd11523 tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-b85b9c20-9949-47ad-9b62-f1b2ee0b2167-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:45 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.info" returned: 0 in 0.444s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:45 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Acquiring lock "cinder-quobyte-56473fb1-7c6f-495d-a188-c8875ee95dbd" by "_copy_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:45 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Lock "cinder-quobyte-56473fb1-7c6f-495d-a188-c8875ee95dbd" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:45 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] snapshot: 7e40b136-df1f-47a0-aa31-bca3a22cbf31, volume: 56473fb1-7c6f-495d-a188-c8875ee95dbd, {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:13:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:45 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:45 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:45 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd072004-871d-40de-8a90-4ed704101cc4]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:45 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31 Apr 07 06:13:45 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Flow 'volume_create_manager' (d8a6253e-8785-4884-9550-afe79a5b02c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e7ff9c-083f-4fc6-bb73-c2ecf4045fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e7ff9c-083f-4fc6-bb73-c2ecf4045fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1747223630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffcd37a-da29-4819-9c14-b3142f06fe0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a074a72fce415aab6c0e0adf0fdabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:46Z,use_quota=True,user_id='2bc1995c244f479b8a4d39cf039f60aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e247e415-ed8d-49bb-b440-ec3f68f6dcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e247e415-ed8d-49bb-b440-ec3f68f6dcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8c6cda-2a75-401e-a105-4cd87c883e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8c6cda-2a75-401e-a105-4cd87c883e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ffcd37a-da29-4819-9c14-b3142f06fe0b', 'volume_name': 'volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32bbfaad-08ee-49c7-be3f-ed85a022b207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32bbfaad-08ee-49c7-be3f-ed85a022b207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56bd099-1803-4f99-9310-3e418e39caee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:46 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Volume 9ffcd37a-da29-4819-9c14-b3142f06fe0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b', 'volume_size': 1} Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:46 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31" returned: 0 in 0.568s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] will copy from snapshot at /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Creating direct copy from snapshot {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fc478d-f08f-4277-b29a-baadde784f86]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:46 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 Apr 07 06:13:46 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:46 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5" returned: 0 in 0.491s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG cinder.utils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Path /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-56473fb1-7c6f-495d-a188-c8875ee95dbd not found in is_blk_device check {{(pid=82475) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:13:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-56473fb1-7c6f-495d-a188-c8875ee95dbd {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:46 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-56473fb1-7c6f-495d-a188-c8875ee95dbd Apr 07 06:13:46 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:49 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-56473fb1-7c6f-495d-a188-c8875ee95dbd" returned: 0 in 2.159s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:49 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[106f0ab2-5cdb-4f0f-8ef5-f470f46e3fc8]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:49 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 Apr 07 06:13:49 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:49 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Flow 'volume_create_manager' (979bf95b-a9f8-4323-82df-0aacf36b23fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3599ca5-fe0b-4961-b24e-f28e9f58b1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3599ca5-fe0b-4961-b24e-f28e9f58b1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-341154302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee326020-d5ef-431b-8bca-7ef1e9fbe55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1f64f544d54a05a981bd182e8ed003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:49Z,use_quota=True,user_id='330c8c133f6740c2945b35e7557e67e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861006d4-97ec-46e5-a555-08b4def81134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861006d4-97ec-46e5-a555-08b4def81134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31ecdcc-542f-4b38-9535-5ab0ceeb2414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31ecdcc-542f-4b38-9535-5ab0ceeb2414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee326020-d5ef-431b-8bca-7ef1e9fbe55e', 'volume_name': 'volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e', 'volume_size': 2}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a005b92-95dd-4600-8274-325bbe31419e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a005b92-95dd-4600-8274-325bbe31419e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e51b17-2c8a-4a3f-9857-0e12f07db87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:49 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Volume ee326020-d5ef-431b-8bca-7ef1e9fbe55e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e', 'volume_size': 2} Apr 07 06:13:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:49 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5" returned: 0 in 0.595s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:49 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Image conversion details: src /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-56473fb1-7c6f-495d-a188-c8875ee95dbd {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:13:49 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Converted 1024.00 MB image at 474.16 MB/s Apr 07 06:13:49 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-56473fb1-7c6f-495d-a188-c8875ee95dbd is being set with open permissions: ugo+rw Apr 07 06:13:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-56473fb1-7c6f-495d-a188-c8875ee95dbd {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:49 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-56473fb1-7c6f-495d-a188-c8875ee95dbd Apr 07 06:13:49 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:50 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-56473fb1-7c6f-495d-a188-c8875ee95dbd" returned: 0 in 0.382s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Lock "cinder-quobyte-56473fb1-7c6f-495d-a188-c8875ee95dbd" released by "_copy_volume_from_snapshot" :: held 4.245s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Acquiring lock "cinder-quobyte-7e40b136-df1f-47a0-aa31-bca3a22cbf31" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Lock "cinder-quobyte-7e40b136-df1f-47a0-aa31-bca3a22cbf31" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:50 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Deleting offline snapshot 7e40b136-df1f-47a0-aa31-bca3a22cbf31 of volume 009c3442-9cbc-4448-b8d3-7ee8bf707cb5 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:13:50 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] snapshot_file for this snap is: volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:13:50 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[69df1c77-d911-4324-8baf-29eb99e67c48]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:50 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31 Apr 07 06:13:50 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:50 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31" returned: 0 in 0.456s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:50 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:13:50 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3efb344-b25d-4cf7-bb06-d360206028c8]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:50 devstack sudo[89013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 Apr 07 06:13:50 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:51 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5" returned: 0 in 0.467s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:51 devstack sudo[89018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31 Apr 07 06:13:51 devstack sudo[89018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:51 devstack sudo[89018]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31" returned: 0 in 0.473s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:51 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31 Apr 07 06:13:51 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG oslo_service.periodic_task [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82475) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:51 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:51 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:51 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5.7e40b136-df1f-47a0-aa31-bca3a22cbf31" returned: 0 in 0.419s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Lock "cinder-quobyte-7e40b136-df1f-47a0-aa31-bca3a22cbf31" released by "_delete_snapshot" :: held 1.866s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.177s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.723s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1747223630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffcd37a-da29-4819-9c14-b3142f06fe0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a074a72fce415aab6c0e0adf0fdabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:46Z,use_quota=True,user_id='2bc1995c244f479b8a4d39cf039f60aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Creating volume 9ffcd37a-da29-4819-9c14-b3142f06fe0b {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:51 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bbe1f18-fae0-4e9f-a6f8-47fa6d0d6fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56473fb1-7c6f-495d-a188-c8875ee95dbd', 'volume_size': 2, 'source_volid': '009c3442-9cbc-4448-b8d3-7ee8bf707cb5', 'source_volstatus': 'available'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fe910dd-963a-426e-9464-1df7dfccd38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:51 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b 1073741824 Apr 07 06:13:51 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:51 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Volume volume-56473fb1-7c6f-495d-a188-c8875ee95dbd (56473fb1-7c6f-495d-a188-c8875ee95dbd): created successfully Apr 07 06:13:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fe910dd-963a-426e-9464-1df7dfccd38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Flow 'volume_create_manager' (59475c57-90fb-4feb-8297-9458ac36dea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:52 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-1bd6116c-1265-499c-977a-3cd88513d5dd tempest-VolumesCloneTest-7396751 None] Created volume successfully. Apr 07 06:13:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] Acquiring lock "cinder-56473fb1-7c6f-495d-a188-c8875ee95dbd-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:52 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.471s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:52 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] Lock "cinder-56473fb1-7c6f-495d-a188-c8875ee95dbd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] Acquiring lock "cinder-quobyte-56473fb1-7c6f-495d-a188-c8875ee95dbd" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] Lock "cinder-quobyte-56473fb1-7c6f-495d-a188-c8875ee95dbd" acquired by "delete_volume" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:52 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[68366dcd-96b8-4d68-98a3-20e531ebca03]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-56473fb1-7c6f-495d-a188-c8875ee95dbd {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:52 devstack sudo[89034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-56473fb1-7c6f-495d-a188-c8875ee95dbd Apr 07 06:13:52 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:52 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b 1073741824" returned: 0 in 0.547s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:52 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b Apr 07 06:13:52 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:52 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-56473fb1-7c6f-495d-a188-c8875ee95dbd" returned: 0 in 0.513s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-56473fb1-7c6f-495d-a188-c8875ee95dbd {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:52 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-56473fb1-7c6f-495d-a188-c8875ee95dbd Apr 07 06:13:52 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:52 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b" returned: 0 in 0.460s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.660s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-341154302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee326020-d5ef-431b-8bca-7ef1e9fbe55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1f64f544d54a05a981bd182e8ed003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:49Z,use_quota=True,user_id='330c8c133f6740c2945b35e7557e67e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Creating volume ee326020-d5ef-431b-8bca-7ef1e9fbe55e {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:13:53 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e 2147483648 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56bd099-1803-4f99-9310-3e418e39caee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:53 devstack sudo[89044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e 2147483648 Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a211c9db-da7b-4510-90a0-5d35b2e5466e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:53 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:53 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Volume volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b (9ffcd37a-da29-4819-9c14-b3142f06fe0b): created successfully Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a211c9db-da7b-4510-90a0-5d35b2e5466e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Flow 'volume_create_manager' (d8a6253e-8785-4884-9550-afe79a5b02c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:53 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-101d132e-d81e-457f-b0f2-7a130bb32fc2 tempest-VolumeDependencyTests-1445952737 None] Created volume successfully. Apr 07 06:13:53 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-56473fb1-7c6f-495d-a188-c8875ee95dbd" returned: 0 in 0.409s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] Lock "cinder-quobyte-56473fb1-7c6f-495d-a188-c8875ee95dbd" released by "delete_volume" :: held 0.954s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] Created reservations ['66a2bb77-4948-4244-85f9-df81f434d0de', '08868fb3-501f-4dad-8928-7149f8c93624', '65326b51-94a7-4517-a6e4-b21c8dc3ae76', 'a6b54462-749e-423a-a963-048e7e0f7324'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:53 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:53 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] Acquiring lock "cinder-009c3442-9cbc-4448-b8d3-7ee8bf707cb5-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] Lock "cinder-009c3442-9cbc-4448-b8d3-7ee8bf707cb5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] Acquiring lock "cinder-quobyte-009c3442-9cbc-4448-b8d3-7ee8bf707cb5" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] Lock "cinder-quobyte-009c3442-9cbc-4448-b8d3-7ee8bf707cb5" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[220843c6-9c38-4bdc-93ec-63fb04c0802b]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:53 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e 2147483648" returned: 0 in 0.675s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:53 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 Apr 07 06:13:53 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:53 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e Apr 07 06:13:53 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:53 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.481s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:53 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] Deleted volume successfully. Apr 07 06:13:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-da2b8d53-532b-4266-b736-46fda9b4a159 tempest-VolumesCloneTest-7396751 None] Lock "cinder-56473fb1-7c6f-495d-a188-c8875ee95dbd-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Flow 'volume_create_manager' (59faf7c3-cba4-4a9c-857e-e812d8b3e5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fe43fd-3a26-4081-ab8b-2dc145d4f36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fe43fd-3a26-4081-ab8b-2dc145d4f36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1080103326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d13b4aa5-b288-4872-a4d5-1237c685e760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a074a72fce415aab6c0e0adf0fdabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9ffcd37a-da29-4819-9c14-b3142f06fe0b,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:54Z,use_quota=True,user_id='2bc1995c244f479b8a4d39cf039f60aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:54 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a9c11d-d55b-45c7-a839-098a459a02b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a9c11d-d55b-45c7-a839-098a459a02b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc40974-89ce-440b-9e85-e10dac9871f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5" returned: 0 in 0.538s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:54 devstack sudo[89061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5 Apr 07 06:13:54 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc40974-89ce-440b-9e85-e10dac9871f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd13b4aa5-b288-4872-a4d5-1237c685e760', 'volume_name': 'volume-d13b4aa5-b288-4872-a4d5-1237c685e760', 'volume_size': 1, 'source_volid': '9ffcd37a-da29-4819-9c14-b3142f06fe0b', 'source_volstatus': 'available'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:54 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab1be12-032e-4bad-b0fc-6b5a6aa04331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab1be12-032e-4bad-b0fc-6b5a6aa04331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09265224-e874-49aa-876e-6adc35800efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:54 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Volume d13b4aa5-b288-4872-a4d5-1237c685e760: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d13b4aa5-b288-4872-a4d5-1237c685e760', 'volume_size': 1, 'source_volid': '9ffcd37a-da29-4819-9c14-b3142f06fe0b', 'source_volstatus': 'available'} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e" returned: 0 in 0.458s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:54 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Cloning volume 9ffcd37a-da29-4819-9c14-b3142f06fe0b to volume d13b4aa5-b288-4872-a4d5-1237c685e760 Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e51b17-2c8a-4a3f-9857-0e12f07db87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e', 'volume_size': 2}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c24f56-1000-4b40-bd61-602f2c2cdc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Creating offline snapshot 71f9e53c-9085-4be9-a37e-43a6ebfa34f4 of volume 9ffcd37a-da29-4819-9c14-b3142f06fe0b {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:13:54 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Volume volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e (ee326020-d5ef-431b-8bca-7ef1e9fbe55e): created successfully Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c24f56-1000-4b40-bd61-602f2c2cdc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Flow 'volume_create_manager' (979bf95b-a9f8-4323-82df-0aacf36b23fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b6cdaf-b74d-4a40-995c-314e35c24c06]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:54 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-43be4290-1d2e-43cc-9392-f1960eedea54 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Created volume successfully. Apr 07 06:13:54 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b Apr 07 06:13:54 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:54 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-009c3442-9cbc-4448-b8d3-7ee8bf707cb5" returned: 0 in 0.458s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] Lock "cinder-quobyte-009c3442-9cbc-4448-b8d3-7ee8bf707cb5" released by "delete_volume" :: held 1.035s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-65045f98-02dc-4c39-9c0f-f38081a40761 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] Created reservations ['ec909d56-b83e-4ed1-9d15-5d2792df937f', 'f6c7bcfe-a8f8-4316-b3a3-a3cb6f94c629', '4a3ac790-ea1e-4ca1-af2e-2d2a5040be11', '6f9daf2e-16be-4c5e-b5ca-9965b3c5329f'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:54 devstack sudo[89069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:13:54 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:54 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b" returned: 0 in 0.502s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:54 devstack sudo[89071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4 1G Apr 07 06:13:54 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:55 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.420s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:55 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:13:55 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] Deleted volume successfully. Apr 07 06:13:55 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fb9176b7-205d-453f-9902-3f9cca322c85 tempest-VolumesCloneTest-7396751 None] Lock "cinder-009c3442-9cbc-4448-b8d3-7ee8bf707cb5-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:13:55 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4 1G" returned: 0 in 0.496s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:55 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4 Apr 07 06:13:55 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:55 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4" returned: 0 in 0.483s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:55 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4 is being set with open permissions: ugo+rw Apr 07 06:13:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:55 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4 Apr 07 06:13:55 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:56 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4" returned: 0 in 0.474s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:56 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.info Apr 07 06:13:56 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:56 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.info" returned: 0 in 0.494s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:56 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.info is being set with open permissions: ugo+rw Apr 07 06:13:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:56 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.info Apr 07 06:13:56 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:57 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.info" returned: 0 in 0.441s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "cinder-quobyte-d13b4aa5-b288-4872-a4d5-1237c685e760" by "_copy_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-d13b4aa5-b288-4872-a4d5-1237c685e760" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] snapshot: 71f9e53c-9085-4be9-a37e-43a6ebfa34f4, volume: d13b4aa5-b288-4872-a4d5-1237c685e760, {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[253d83d0-0153-4cf6-b983-a8a32b7e4370]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:57 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4 Apr 07 06:13:57 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Flow 'volume_create_manager' (a8dbaba9-6ffa-491e-b05d-d1fe68d20051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5492ea6e-f317-4818-b021-99e476ca2a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5492ea6e-f317-4818-b021-99e476ca2a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1205778082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7bcf83-d412-45ec-8159-ab90aa7bbe7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d2b27f37f940ac825c3eb60d4f380c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:58Z,use_quota=True,user_id='06e83a16f9724d29a51fb1b51b354b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62092cfe-fadd-4600-bc50-e7ce4a7221f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62092cfe-fadd-4600-bc50-e7ce4a7221f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a324b6-ed52-42da-a9ca-9ba1ccb5fa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG cinder.image.glance [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Creating Keystone auth plugin from conf {{(pid=82475) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 07 06:13:57 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4" returned: 0 in 0.526s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] will copy from snapshot at /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Creating direct copy from snapshot {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04bbc4b-3917-4dd1-953e-58b7e70ff80b]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:57 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b Apr 07 06:13:57 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a324b6-ed52-42da-a9ca-9ba1ccb5fa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4c7bcf83-d412-45ec-8159-ab90aa7bbe7c', 'volume_name': 'volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c', 'volume_size': 1, 'image_id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b1699f15f0f4ed99342800159112237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e597d39-f7d0-437d-988f-e2351ab702ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a30ad48-9f65-4bb8-8f14-498066205e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a30ad48-9f65-4bb8-8f14-498066205e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:13:58 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abeb7b85-3bba-446b-b9d9-c5d90babb175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:13:58 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Volume 4c7bcf83-d412-45ec-8159-ab90aa7bbe7c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c', 'volume_size': 1, 'image_id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b1699f15f0f4ed99342800159112237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e597d39-f7d0-437d-988f-e2351ab702ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 07 06:13:58 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Trying to clone 4c7bcf83-d412-45ec-8159-ab90aa7bbe7c from image 2e597d39-f7d0-437d-988f-e2351ab702ec at location (None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}]). {{(pid=82475) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 07 06:13:58 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f39zecyldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82475) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 07 06:13:58 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Image download 20.69 MB at 20.69 MB/s Apr 07 06:13:58 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0669ca-3e54-41ba-9d35-38b3ee4920c2]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f39zecyldevstack@QuobyteHD {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:58 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b" returned: 0 in 0.517s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:58 devstack cinder-volume[82475]: DEBUG cinder.utils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Path /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d13b4aa5-b288-4872-a4d5-1237c685e760 not found in is_blk_device check {{(pid=82475) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:13:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d13b4aa5-b288-4872-a4d5-1237c685e760 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:58 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f39zecyldevstack@QuobyteHD Apr 07 06:13:58 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:58 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d13b4aa5-b288-4872-a4d5-1237c685e760 Apr 07 06:13:58 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:13:58 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Apr 07 06:13:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f39zecyldevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:13:58 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Temporary image 2e597d39-f7d0-437d-988f-e2351ab702ec is fetched for user 06e83a16f9724d29a51fb1b51b354b5c. {{(pid=82475) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 07 06:13:58 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[637c408a-3480-47a0-8e20-0ceb1d9f6ede]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:13:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f39zecyldevstack@QuobyteHD {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:13:59 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f39zecyldevstack@QuobyteHD Apr 07 06:13:59 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:00 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f39zecyldevstack@QuobyteHD" returned: 0 in 1.330s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:00 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d13b4aa5-b288-4872-a4d5-1237c685e760" returned: 0 in 1.999s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:00 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[4145d033-10af-4192-a689-a9ed9fc2483f]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:00 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b Apr 07 06:14:00 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:00 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b" returned: 0 in 0.566s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:00 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Image conversion details: src /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b, size 1024.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d13b4aa5-b288-4872-a4d5-1237c685e760 {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:14:00 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Converted 1024.00 MB image at 511.99 MB/s Apr 07 06:14:00 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d13b4aa5-b288-4872-a4d5-1237c685e760 is being set with open permissions: ugo+rw Apr 07 06:14:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d13b4aa5-b288-4872-a4d5-1237c685e760 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:00 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d13b4aa5-b288-4872-a4d5-1237c685e760 Apr 07 06:14:00 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:01 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d13b4aa5-b288-4872-a4d5-1237c685e760" returned: 0 in 0.367s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-d13b4aa5-b288-4872-a4d5-1237c685e760" released by "_copy_volume_from_snapshot" :: held 4.023s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "cinder-quobyte-71f9e53c-9085-4be9-a37e-43a6ebfa34f4" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-71f9e53c-9085-4be9-a37e-43a6ebfa34f4" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:01 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Deleting offline snapshot 71f9e53c-9085-4be9-a37e-43a6ebfa34f4 of volume 9ffcd37a-da29-4819-9c14-b3142f06fe0b {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:14:01 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] snapshot_file for this snap is: volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:14:01 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3354771-51b8-40d9-b3d7-90d569e4271d]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:01 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4 Apr 07 06:14:01 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:01 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4" returned: 0 in 0.437s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:01 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:14:01 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3df89b4-7f80-482f-bcb1-419b46c96c5c]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:01 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b Apr 07 06:14:01 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:02 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b" returned: 0 in 0.456s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:02 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4 Apr 07 06:14:02 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:02 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4" returned: 0 in 0.431s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:02 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4 Apr 07 06:14:02 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:03 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b.71f9e53c-9085-4be9-a37e-43a6ebfa34f4" returned: 0 in 0.403s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-71f9e53c-9085-4be9-a37e-43a6ebfa34f4" released by "_delete_snapshot" :: held 1.775s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.906s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-65045f98-02dc-4c39-9c0f-f38081a40761 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.418s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:03 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09265224-e874-49aa-876e-6adc35800efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d13b4aa5-b288-4872-a4d5-1237c685e760', 'volume_size': 1, 'source_volid': '9ffcd37a-da29-4819-9c14-b3142f06fe0b', 'source_volstatus': 'available'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:03 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18dde8fb-8812-42d9-8056-5c8b34d12093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-65045f98-02dc-4c39-9c0f-f38081a40761 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Creating offline snapshot 69378f90-6ee5-470e-9a0a-b89368db77be of volume ee326020-d5ef-431b-8bca-7ef1e9fbe55e {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:14:03 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Volume volume-d13b4aa5-b288-4872-a4d5-1237c685e760 (d13b4aa5-b288-4872-a4d5-1237c685e760): created successfully Apr 07 06:14:03 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18dde8fb-8812-42d9-8056-5c8b34d12093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:03 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Flow 'volume_create_manager' (59faf7c3-cba4-4a9c-857e-e812d8b3e5b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:03 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ab7be8-eda0-47c2-b8da-5b75510ecfbb]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65045f98-02dc-4c39-9c0f-f38081a40761 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:03 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-c85d2573-7c5e-4ef2-965c-73085513e939 tempest-VolumeDependencyTests-1445952737 None] Created volume successfully. Apr 07 06:14:03 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e Apr 07 06:14:03 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "cinder-9ffcd37a-da29-4819-9c14-b3142f06fe0b-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-9ffcd37a-da29-4819-9c14-b3142f06fe0b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "cinder-quobyte-9ffcd37a-da29-4819-9c14-b3142f06fe0b" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-9ffcd37a-da29-4819-9c14-b3142f06fe0b" acquired by "delete_volume" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:03 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8464bf-0add-46bd-9fa3-fe48656f567e]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:03 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b Apr 07 06:14:03 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:03 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65045f98-02dc-4c39-9c0f-f38081a40761 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e" returned: 0 in 0.516s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65045f98-02dc-4c39-9c0f-f38081a40761 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be 2G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:03 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be 2G Apr 07 06:14:03 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:04 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b" returned: 0 in 0.477s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:04 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b Apr 07 06:14:04 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:04 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65045f98-02dc-4c39-9c0f-f38081a40761 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be 2G" returned: 0 in 0.490s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65045f98-02dc-4c39-9c0f-f38081a40761 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:04 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be Apr 07 06:14:04 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:04 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-9ffcd37a-da29-4819-9c14-b3142f06fe0b" returned: 0 in 0.409s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-9ffcd37a-da29-4819-9c14-b3142f06fe0b" released by "delete_volume" :: held 0.923s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] Created reservations ['109f819f-169d-405a-9c10-f12a2d245c8d', 'be135d86-4472-4b04-a53f-ec1280031908', '93cc556d-e003-4053-89d5-ef6306e4cfd6', '8462560a-1977-4244-a678-5deb94bcc6a3'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:04 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:14:04 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:04 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65045f98-02dc-4c39-9c0f-f38081a40761 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be" returned: 0 in 0.465s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:04 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-65045f98-02dc-4c39-9c0f-f38081a40761 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be is being set with open permissions: ugo+rw Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65045f98-02dc-4c39-9c0f-f38081a40761 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:04 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be Apr 07 06:14:04 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "cinder-d13b4aa5-b288-4872-a4d5-1237c685e760-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-d13b4aa5-b288-4872-a4d5-1237c685e760-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "cinder-quobyte-d13b4aa5-b288-4872-a4d5-1237c685e760" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-d13b4aa5-b288-4872-a4d5-1237c685e760" acquired by "delete_volume" :: waited 0.022s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[60620d50-589d-4ede-8149-6dd6decbc9ac]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d13b4aa5-b288-4872-a4d5-1237c685e760 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:04 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d13b4aa5-b288-4872-a4d5-1237c685e760 Apr 07 06:14:04 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:05 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.419s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:05 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] Deleted volume successfully. Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-75d96eff-4612-42b6-b371-33378505106b tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-9ffcd37a-da29-4819-9c14-b3142f06fe0b-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:05 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65045f98-02dc-4c39-9c0f-f38081a40761 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be" returned: 0 in 0.486s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65045f98-02dc-4c39-9c0f-f38081a40761 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:05 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.info Apr 07 06:14:05 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:05 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d13b4aa5-b288-4872-a4d5-1237c685e760" returned: 0 in 0.525s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d13b4aa5-b288-4872-a4d5-1237c685e760 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:05 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d13b4aa5-b288-4872-a4d5-1237c685e760 Apr 07 06:14:05 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:05 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65045f98-02dc-4c39-9c0f-f38081a40761 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.info" returned: 0 in 0.408s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:05 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-65045f98-02dc-4c39-9c0f-f38081a40761 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.info is being set with open permissions: ugo+rw Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65045f98-02dc-4c39-9c0f-f38081a40761 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:05 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.info Apr 07 06:14:05 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:05 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d13b4aa5-b288-4872-a4d5-1237c685e760" returned: 0 in 0.396s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-d13b4aa5-b288-4872-a4d5-1237c685e760" released by "delete_volume" :: held 0.943s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] Created reservations ['772936e5-2170-48aa-8912-5da9d56b0fa1', '794202bd-7c38-4ce9-b341-0750ceaad72b', '83b35ad6-a9aa-4f3a-86cd-2bcd7516343d', '4a18f0fc-2eb3-49e2-959b-5c1b48661725'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:05 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:14:05 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "cinder-ec88290a-35ec-4209-a67a-d291452079ba-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-ec88290a-35ec-4209-a67a-d291452079ba-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "cinder-quobyte-ec88290a-35ec-4209-a67a-d291452079ba" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-ec88290a-35ec-4209-a67a-d291452079ba" acquired by "delete_volume" :: waited 0.006s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeca811c-52e0-494f-84a4-1178a4c78bfe]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ec88290a-35ec-4209-a67a-d291452079ba {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:06 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ec88290a-35ec-4209-a67a-d291452079ba Apr 07 06:14:06 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:06 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65045f98-02dc-4c39-9c0f-f38081a40761 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.info" returned: 0 in 0.471s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-65045f98-02dc-4c39-9c0f-f38081a40761 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.912s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.901s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1205778082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7bcf83-d412-45ec-8159-ab90aa7bbe7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d2b27f37f940ac825c3eb60d4f380c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:13:58Z,use_quota=True,user_id='06e83a16f9724d29a51fb1b51b354b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Creating volume 4c7bcf83-d412-45ec-8159-ab90aa7bbe7c {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:06 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:06 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c 1073741824 Apr 07 06:14:06 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:06 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-65045f98-02dc-4c39-9c0f-f38081a40761 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Create snapshot completed successfully Apr 07 06:14:06 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.467s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:06 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] Deleted volume successfully. Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-33deaf35-9e19-45e6-bc21-465d2b8db26c tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-d13b4aa5-b288-4872-a4d5-1237c685e760-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:06 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ec88290a-35ec-4209-a67a-d291452079ba" returned: 0 in 0.490s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ec88290a-35ec-4209-a67a-d291452079ba {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:06 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ec88290a-35ec-4209-a67a-d291452079ba Apr 07 06:14:06 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:06 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c 1073741824" returned: 0 in 0.478s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:06 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c Apr 07 06:14:06 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:06 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ec88290a-35ec-4209-a67a-d291452079ba" returned: 0 in 0.409s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-quobyte-ec88290a-35ec-4209-a67a-d291452079ba" released by "delete_volume" :: held 0.919s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] Created reservations ['b65e87d0-fa32-4fe6-b998-8c562878e8bf', '435500b3-58e1-4356-a3d4-95ba86cca9a0', 'be956b83-3db2-4e64-9e35-bad698acf10b', '92c7d371-db59-453d-8e9f-c4114a229c76'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:06 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:14:06 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:07 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c" returned: 0 in 0.447s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG cinder.volume.volume_utils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Attempting download of 2e597d39-f7d0-437d-988f-e2351ab702ec ((None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}])) to volume 4c7bcf83-d412-45ec-8159-ab90aa7bbe7c. {{(pid=82475) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d7cbfd-08b9-44f4-bbc1-cb7924ae1cae]: (4, 'raw') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_n_8tcdvq {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Acquiring lock "cinder-69378f90-6ee5-470e-9a0a-b89368db77be-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:07 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_n_8tcdvq Apr 07 06:14:07 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Lock "cinder-69378f90-6ee5-470e-9a0a-b89368db77be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Acquiring lock "cinder-quobyte-ee326020-d5ef-431b-8bca-7ef1e9fbe55e" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Lock "cinder-quobyte-ee326020-d5ef-431b-8bca-7ef1e9fbe55e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Acquiring lock "cinder-quobyte-69378f90-6ee5-470e-9a0a-b89368db77be" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Lock "cinder-quobyte-69378f90-6ee5-470e-9a0a-b89368db77be" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Deleting offline snapshot 69378f90-6ee5-470e-9a0a-b89368db77be of volume ee326020-d5ef-431b-8bca-7ef1e9fbe55e {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] snapshot_file for this snap is: volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f83cbc-cd15-4b3d-a120-77e635785a4d]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:07 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be Apr 07 06:14:07 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:07 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.475s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:07 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] Deleted volume successfully. Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-07de3ba8-9b5b-492a-8f69-5ed020b0d274 tempest-VolumeDependencyTests-1445952737 None] Lock "cinder-ec88290a-35ec-4209-a67a-d291452079ba-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:07 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_n_8tcdvq" returned: 0 in 0.552s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_n_8tcdvq {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:07 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_n_8tcdvq Apr 07 06:14:07 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:07 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be" returned: 0 in 0.573s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d871cc-6ab8-4cc1-b6bd-9599e5bd8baa]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:07 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e Apr 07 06:14:07 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:08 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_n_8tcdvq" returned: 1 in 0.472s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_n_8tcdvq' failed. Not Retrying. {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:14:08 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[953899c3-4d11-48f7-8e00-3eee7177104f]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f39zecyldevstack@QuobyteHD {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:08 devstack sudo[89240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f39zecyldevstack@QuobyteHD Apr 07 06:14:08 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:08 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e" returned: 0 in 0.556s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:08 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be Apr 07 06:14:08 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:08 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f39zecyldevstack@QuobyteHD" returned: 0 in 0.535s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:08 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] 2e597d39-f7d0-437d-988f-e2351ab702ec was qcow2, converting to raw {{(pid=82475) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 07 06:14:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f39zecyldevstack@QuobyteHD /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:08 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f39zecyldevstack@QuobyteHD /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c Apr 07 06:14:08 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:08 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be" returned: 0 in 0.521s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:08 devstack sudo[89255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be Apr 07 06:14:08 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Flow 'volume_create_manager' (0d662f60-3e45-4042-9941-025143f6ae44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88aa7b59-df8b-46b2-b2a3-0241ebd95751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88aa7b59-df8b-46b2-b2a3-0241ebd95751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d35c4f-8d19-4998-b746-b5084845da93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a5a91f49204a58966f1e9052186cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:09Z,use_quota=True,user_id='e90133ec5da140119ee1502bcfe5780c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d2073a8-1e1d-4772-8d96-d6808c171196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d2073a8-1e1d-4772-8d96-d6808c171196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45129c20-b063-415b-9d1c-f7a90ada7cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45129c20-b063-415b-9d1c-f7a90ada7cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d35c4f-8d19-4998-b746-b5084845da93', 'volume_name': 'volume-75d35c4f-8d19-4998-b746-b5084845da93', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13341af-8c56-4a3a-887a-25f571d6e851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13341af-8c56-4a3a-887a-25f571d6e851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a4dd6e-1c9d-472b-97db-37a10f761ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:09 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Volume 75d35c4f-8d19-4998-b746-b5084845da93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d35c4f-8d19-4998-b746-b5084845da93', 'volume_size': 1} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d35c4f-8d19-4998-b746-b5084845da93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a5a91f49204a58966f1e9052186cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:09Z,use_quota=True,user_id='e90133ec5da140119ee1502bcfe5780c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Creating volume 75d35c4f-8d19-4998-b746-b5084845da93 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:09 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-75d35c4f-8d19-4998-b746-b5084845da93 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:09 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-75d35c4f-8d19-4998-b746-b5084845da93 1073741824 Apr 07 06:14:09 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:09 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e.69378f90-6ee5-470e-9a0a-b89368db77be" returned: 0 in 0.489s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Lock "cinder-quobyte-69378f90-6ee5-470e-9a0a-b89368db77be" released by "_delete_snapshot" :: held 2.204s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Lock "cinder-quobyte-ee326020-d5ef-431b-8bca-7ef1e9fbe55e" released by "delete_snapshot" :: held 2.224s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Created reservations ['5d8299eb-b916-4998-8d35-932ca4109f88', 'fd9cd618-16c7-4c1b-a843-11405a3b019a', '1bccf9ae-4c5f-4385-a4cb-599112c62c0b', 'ee606898-8948-40f1-91b3-5ab8b017dff9'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:09 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Delete snapshot completed successfully. Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-864a98ee-d452-4b78-a03a-eb62a7298735 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Lock "cinder-69378f90-6ee5-470e-9a0a-b89368db77be-delete_snapshot" released by "delete_snapshot" :: held 2.340s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:09 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-75d35c4f-8d19-4998-b746-b5084845da93 1073741824" returned: 0 in 0.572s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-75d35c4f-8d19-4998-b746-b5084845da93 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:09 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f39zecyldevstack@QuobyteHD /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c" returned: 0 in 1.083s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f39zecyldevstack@QuobyteHD, size 112.00 MB, duration 1.08 sec, destination /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:14:09 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Converted 112.00 MB image at 103.30 MB/s Apr 07 06:14:09 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-75d35c4f-8d19-4998-b746-b5084845da93 Apr 07 06:14:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:09 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:09 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c 1G Apr 07 06:14:09 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:10 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-75d35c4f-8d19-4998-b746-b5084845da93" returned: 0 in 0.411s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a4dd6e-1c9d-472b-97db-37a10f761ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d35c4f-8d19-4998-b746-b5084845da93', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1badd717-7699-4c39-9682-3b1062bd8a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:10 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Volume volume-75d35c4f-8d19-4998-b746-b5084845da93 (75d35c4f-8d19-4998-b746-b5084845da93): created successfully Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1badd717-7699-4c39-9682-3b1062bd8a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Flow 'volume_create_manager' (0d662f60-3e45-4042-9941-025143f6ae44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:10 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-fcf7b0dd-417b-466c-9a9e-b7d527ca52aa tempest-CinderUnicodeTest-160813220 None] Created volume successfully. Apr 07 06:14:10 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c 1G" returned: 0 in 0.450s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c080ae-576d-4b3a-bc1d-93a5a68575e2]: (4, 'raw') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:10 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c Apr 07 06:14:10 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Acquiring lock "cinder-ee326020-d5ef-431b-8bca-7ef1e9fbe55e-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Lock "cinder-ee326020-d5ef-431b-8bca-7ef1e9fbe55e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Acquiring lock "cinder-quobyte-ee326020-d5ef-431b-8bca-7ef1e9fbe55e" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Lock "cinder-quobyte-ee326020-d5ef-431b-8bca-7ef1e9fbe55e" acquired by "delete_volume" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eda2a3e-601c-4637-b07c-035f11776a59]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:10 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e Apr 07 06:14:10 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:10 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c" returned: 0 in 0.520s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:10 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c Apr 07 06:14:10 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:10 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e" returned: 0 in 0.493s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:11 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e Apr 07 06:14:11 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:11 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c" returned: 1 in 0.539s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c' failed. Not Retrying. {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.volume_utils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Downloaded image 2e597d39-f7d0-437d-988f-e2351ab702ec ((None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}])) to volume 4c7bcf83-d412-45ec-8159-ab90aa7bbe7c successfully. {{(pid=82475) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Temporary image 2e597d39-f7d0-437d-988f-e2351ab702ec for user 06e83a16f9724d29a51fb1b51b354b5c is deleted. {{(pid=82475) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.volume_utils [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Marking volume 4c7bcf83-d412-45ec-8159-ab90aa7bbe7c as bootable. {{(pid=82475) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Copying metadata from image 2e597d39-f7d0-437d-988f-e2351ab702ec to 4c7bcf83-d412-45ec-8159-ab90aa7bbe7c. {{(pid=82475) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Creating volume glance metadata for volume 4c7bcf83-d412-45ec-8159-ab90aa7bbe7c backed by image 2e597d39-f7d0-437d-988f-e2351ab702ec with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82475) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abeb7b85-3bba-446b-b9d9-c5d90babb175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c', 'volume_size': 1, 'image_id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b1699f15f0f4ed99342800159112237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e597d39-f7d0-437d-988f-e2351ab702ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e8318b-d409-4c04-8f65-fe746b91063e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:11 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Volume volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c (4c7bcf83-d412-45ec-8159-ab90aa7bbe7c): created successfully Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e8318b-d409-4c04-8f65-fe746b91063e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Flow 'volume_create_manager' (a8dbaba9-6ffa-491e-b05d-d1fe68d20051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:11 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d70bc095-10b1-4adc-b4a6-ade5607e690f tempest-VolumesExtendTest-151415834 None] Created volume successfully. Apr 07 06:14:11 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee326020-d5ef-431b-8bca-7ef1e9fbe55e" returned: 0 in 0.507s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Flow 'volume_create_manager' (7e0ea1b7-1708-4773-9b82-b69133881576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597f125a-42ca-40cf-a0e9-047e18ed0ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Lock "cinder-quobyte-ee326020-d5ef-431b-8bca-7ef1e9fbe55e" released by "delete_volume" :: held 1.066s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597f125a-42ca-40cf-a0e9-047e18ed0ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-367226867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6170fe-e950-491b-84b2-e55fab157a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a5a91f49204a58966f1e9052186cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:11Z,use_quota=True,user_id='e90133ec5da140119ee1502bcfe5780c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a560f503-31d0-46cf-ad59-576bdf7aa6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a560f503-31d0-46cf-ad59-576bdf7aa6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12b2a66-f781-41fd-8719-b10caa955f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12b2a66-f781-41fd-8719-b10caa955f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad6170fe-e950-491b-84b2-e55fab157a13', 'volume_name': 'volume-ad6170fe-e950-491b-84b2-e55fab157a13', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a791dd-dfc3-440a-98ad-b3004d93392f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a791dd-dfc3-440a-98ad-b3004d93392f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2170d43a-90a1-4703-9394-51328e2533e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:11 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Volume ad6170fe-e950-491b-84b2-e55fab157a13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad6170fe-e950-491b-84b2-e55fab157a13', 'volume_size': 1} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-367226867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6170fe-e950-491b-84b2-e55fab157a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a5a91f49204a58966f1e9052186cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:11Z,use_quota=True,user_id='e90133ec5da140119ee1502bcfe5780c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Creating volume ad6170fe-e950-491b-84b2-e55fab157a13 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:11 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:11 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13 1073741824 Apr 07 06:14:11 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Created reservations ['c58c2d73-76fe-49cb-b24f-45491fbdb58c', 'b44049df-2b45-4ad3-acb2-5206700ab17f', '0f2e6953-f271-4850-99a9-9df048491951', '5474e670-b5ff-4392-a619-8bbba8670865'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-69ca58d0-87d4-43b4-96f8-abcd16327507 tempest-VolumesExtendTest-151415834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:11 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:14:11 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:12 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13 1073741824" returned: 0 in 0.528s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:12 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.417s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:12 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:12 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Deleted volume successfully. Apr 07 06:14:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d0a6d92c-393c-4cf4-a8c9-ddec481375d5 tempest-VolumesSnapshotNegativeTestJSON-1395184379 None] Lock "cinder-ee326020-d5ef-431b-8bca-7ef1e9fbe55e-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:12 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13 Apr 07 06:14:12 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:12 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13" returned: 0 in 0.398s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:12 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:14:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-69ca58d0-87d4-43b4-96f8-abcd16327507 tempest-VolumesExtendTest-151415834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.859s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:12 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2170d43a-90a1-4703-9394-51328e2533e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad6170fe-e950-491b-84b2-e55fab157a13', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:12 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e5b8ae-284c-47f3-9027-208fe19a2ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:12 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Volume volume-ad6170fe-e950-491b-84b2-e55fab157a13 (ad6170fe-e950-491b-84b2-e55fab157a13): created successfully Apr 07 06:14:12 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e5b8ae-284c-47f3-9027-208fe19a2ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:12 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Flow 'volume_create_manager' (7e0ea1b7-1708-4773-9b82-b69133881576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:12 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[e343cc9d-0d7d-4569-b2b2-3dc00baf8380]: (4, 'raw') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-69ca58d0-87d4-43b4-96f8-abcd16327507 tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:12 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-a25e37d6-112e-4e8d-a330-4a9a1a512640 tempest-CinderUnicodeTest-160813220 None] Created volume successfully. Apr 07 06:14:12 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c Apr 07 06:14:12 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:13 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-69ca58d0-87d4-43b4-96f8-abcd16327507 tempest-VolumesExtendTest-151415834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c" returned: 0 in 0.528s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-69ca58d0-87d4-43b4-96f8-abcd16327507 tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:13 devstack sudo[89318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c Apr 07 06:14:13 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:13 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-69ca58d0-87d4-43b4-96f8-abcd16327507 tempest-VolumesExtendTest-151415834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c" returned: 1 in 0.538s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-69ca58d0-87d4-43b4-96f8-abcd16327507 tempest-VolumesExtendTest-151415834 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c' failed. Not Retrying. {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:14:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-69ca58d0-87d4-43b4-96f8-abcd16327507 tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c 2G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-69ca58d0-87d4-43b4-96f8-abcd16327507 tempest-VolumesExtendTest-151415834 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c 2G" returned: 0 in 0.056s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-69ca58d0-87d4-43b4-96f8-abcd16327507 tempest-VolumesExtendTest-151415834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.167s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:13 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:SELECT=200,cinder:INSERT=66,cinder:UPDATE=286,cinder:DELETE=23 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:14:13 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:UPDATE=221,cinder:SELECT=171,cinder:INSERT=72,cinder:DELETE=19 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:14:13 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-69ca58d0-87d4-43b4-96f8-abcd16327507 tempest-VolumesExtendTest-151415834 None] Extend volume completed successfully. Apr 07 06:14:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ed7400ba-b160-4619-9923-1b8127b9ab63 tempest-CinderUnicodeTest-160813220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ed7400ba-b160-4619-9923-1b8127b9ab63 tempest-CinderUnicodeTest-160813220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:13 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ed7400ba-b160-4619-9923-1b8127b9ab63 tempest-CinderUnicodeTest-160813220 None] Creating offline snapshot e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7 of volume ad6170fe-e950-491b-84b2-e55fab157a13 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:14:13 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ea91d3-2802-49cd-bccd-5258b109f78d]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ed7400ba-b160-4619-9923-1b8127b9ab63 tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:13 devstack sudo[89326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13 Apr 07 06:14:13 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] Acquiring lock "cinder-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] Lock "cinder-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] Acquiring lock "cinder-quobyte-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] Lock "cinder-quobyte-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c" acquired by "delete_volume" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:14 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e32304f-20c8-42c7-9c18-fe6c618e4d1a]: (4, 'raw') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:14 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c Apr 07 06:14:14 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:14 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ed7400ba-b160-4619-9923-1b8127b9ab63 tempest-CinderUnicodeTest-160813220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13" returned: 0 in 0.486s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ed7400ba-b160-4619-9923-1b8127b9ab63 tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:14 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7 1G Apr 07 06:14:14 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:14 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c" returned: 0 in 0.464s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:14 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c Apr 07 06:14:14 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:14 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ed7400ba-b160-4619-9923-1b8127b9ab63 tempest-CinderUnicodeTest-160813220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7 1G" returned: 0 in 0.493s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ed7400ba-b160-4619-9923-1b8127b9ab63 tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad6170fe-e950-491b-84b2-e55fab157a13 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:14 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad6170fe-e950-491b-84b2-e55fab157a13 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7 Apr 07 06:14:14 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:15 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c" returned: 1 in 0.484s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c' failed. Not Retrying. {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:14:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:15 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c Apr 07 06:14:15 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:15 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ed7400ba-b160-4619-9923-1b8127b9ab63 tempest-CinderUnicodeTest-160813220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad6170fe-e950-491b-84b2-e55fab157a13 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7" returned: 0 in 0.501s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:15 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-ed7400ba-b160-4619-9923-1b8127b9ab63 tempest-CinderUnicodeTest-160813220 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7 is being set with open permissions: ugo+rw Apr 07 06:14:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ed7400ba-b160-4619-9923-1b8127b9ab63 tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:15 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7 Apr 07 06:14:15 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:15 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c" returned: 0 in 0.445s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:15 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] Lock "cinder-quobyte-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c" released by "delete_volume" :: held 1.433s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:15 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] Created reservations ['7f10ecaf-a068-4862-8f9d-67f716f42553', 'ec7080e3-03eb-4739-b16f-c0f259c913cb', '366481cd-b0b7-4211-940c-bfa8d2531477', 'a0076ff9-3b3a-4a32-9d57-3cc4b6bbb1e3'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:15 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:14:15 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:15 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ed7400ba-b160-4619-9923-1b8127b9ab63 tempest-CinderUnicodeTest-160813220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7" returned: 0 in 0.418s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ed7400ba-b160-4619-9923-1b8127b9ab63 tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:15 devstack sudo[89358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.info Apr 07 06:14:15 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:15 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.432s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:15 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:15 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] Deleted volume successfully. Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-950e6b1e-9d51-4b7b-94af-526428f967db tempest-VolumesExtendTest-151415834 None] Lock "cinder-4c7bcf83-d412-45ec-8159-ab90aa7bbe7c-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:16 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ed7400ba-b160-4619-9923-1b8127b9ab63 tempest-CinderUnicodeTest-160813220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.info" returned: 0 in 0.437s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:16 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-ed7400ba-b160-4619-9923-1b8127b9ab63 tempest-CinderUnicodeTest-160813220 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.info is being set with open permissions: ugo+rw Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ed7400ba-b160-4619-9923-1b8127b9ab63 tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:16 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.info Apr 07 06:14:16 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Flow 'volume_create_manager' (906924dd-e798-4b78-b44b-9b6d6eef8aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c236764-5a71-45ef-b15b-d82b9be456e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c236764-5a71-45ef-b15b-d82b9be456e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1061978876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e3451f-c07d-4775-b03c-f1572efb8fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d2b27f37f940ac825c3eb60d4f380c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:16Z,use_quota=True,user_id='06e83a16f9724d29a51fb1b51b354b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9715d56d-18a0-45e6-a5d2-c4e7cc7580ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9715d56d-18a0-45e6-a5d2-c4e7cc7580ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1861375c-d608-4276-acf6-70c223c61343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1861375c-d608-4276-acf6-70c223c61343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e3451f-c07d-4775-b03c-f1572efb8fdf', 'volume_name': 'volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5cca01-0cf9-4c7f-ae76-0ab6434511dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5cca01-0cf9-4c7f-ae76-0ab6434511dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92058ae-3f48-42d1-a96b-8a7f92cdb5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:16 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Volume e6e3451f-c07d-4775-b03c-f1572efb8fdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf', 'volume_size': 1} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:16 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ed7400ba-b160-4619-9923-1b8127b9ab63 tempest-CinderUnicodeTest-160813220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.info" returned: 0 in 0.460s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ed7400ba-b160-4619-9923-1b8127b9ab63 tempest-CinderUnicodeTest-160813220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.868s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.268s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1061978876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e3451f-c07d-4775-b03c-f1572efb8fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d2b27f37f940ac825c3eb60d4f380c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:16Z,use_quota=True,user_id='06e83a16f9724d29a51fb1b51b354b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Creating volume e6e3451f-c07d-4775-b03c-f1572efb8fdf {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:16 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:14:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:16 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf 1073741824 Apr 07 06:14:16 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:16 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-ed7400ba-b160-4619-9923-1b8127b9ab63 tempest-CinderUnicodeTest-160813220 None] Create snapshot completed successfully Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] Acquiring lock "cinder-e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] Lock "cinder-e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] Acquiring lock "cinder-quobyte-ad6170fe-e950-491b-84b2-e55fab157a13" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] Lock "cinder-quobyte-ad6170fe-e950-491b-84b2-e55fab157a13" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] Acquiring lock "cinder-quobyte-e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] Lock "cinder-quobyte-e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] Deleting offline snapshot e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7 of volume ad6170fe-e950-491b-84b2-e55fab157a13 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] snapshot_file for this snap is: volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1117c9-abf6-4468-9653-34fcef5ae811]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:17 devstack sudo[89367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7 Apr 07 06:14:17 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:17 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf 1073741824" returned: 0 in 0.550s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:17 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf Apr 07 06:14:17 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:17 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7" returned: 0 in 0.519s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad6170fe-e950-491b-84b2-e55fab157a13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c72073a-19ea-4cb1-b9ac-3264187ed5f3]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:17 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13 Apr 07 06:14:17 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:17 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf" returned: 0 in 0.465s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92058ae-3f48-42d1-a96b-8a7f92cdb5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1efb5726-84ba-4b3f-b504-c6979f945f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:17 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Volume volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf (e6e3451f-c07d-4775-b03c-f1572efb8fdf): created successfully Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1efb5726-84ba-4b3f-b504-c6979f945f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:17 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Flow 'volume_create_manager' (906924dd-e798-4b78-b44b-9b6d6eef8aff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:17 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d89e38f2-6555-49d6-8067-d9064beef798 tempest-VolumesExtendTest-151415834 None] Created volume successfully. Apr 07 06:14:18 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13" returned: 0 in 0.485s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:18 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7 Apr 07 06:14:18 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:18 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7" returned: 0 in 0.489s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:18 devstack sudo[89422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7 Apr 07 06:14:18 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4f344885-5b64-4294-9d22-e14f3e9270b5 tempest-VolumesExtendTest-151415834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4f344885-5b64-4294-9d22-e14f3e9270b5 tempest-VolumesExtendTest-151415834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:18 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-4f344885-5b64-4294-9d22-e14f3e9270b5 tempest-VolumesExtendTest-151415834 None] Creating offline snapshot 532a9193-20b4-49a7-9cca-aa73eff673d4 of volume e6e3451f-c07d-4775-b03c-f1572efb8fdf {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:14:18 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f530ed-98b5-46a6-a877-413007292334]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4f344885-5b64-4294-9d22-e14f3e9270b5 tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:18 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf Apr 07 06:14:18 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:18 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13.e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7" returned: 0 in 0.413s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] Lock "cinder-quobyte-e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7" released by "_delete_snapshot" :: held 1.967s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] Lock "cinder-quobyte-ad6170fe-e950-491b-84b2-e55fab157a13" released by "delete_snapshot" :: held 1.980s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:19 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] Created reservations ['1e9e0c53-9c5b-45d7-b6a6-f6e26ff04b9d', 'fe60a33f-477a-4e80-9d84-6f9f353944f8', '9e19efff-a989-465b-9662-43d233d99da8', 'abb665c0-14a2-4557-8208-cb9d6e7a4664'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:19 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] Delete snapshot completed successfully. Apr 07 06:14:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-ae4ccc49-46ce-4dc0-851b-c07c4fe82a3d tempest-CinderUnicodeTest-160813220 None] Lock "cinder-e960c51f-b29c-4ef6-8aeb-d3cc42f17bc7-delete_snapshot" released by "delete_snapshot" :: held 2.123s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:19 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4f344885-5b64-4294-9d22-e14f3e9270b5 tempest-VolumesExtendTest-151415834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf" returned: 0 in 0.479s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4f344885-5b64-4294-9d22-e14f3e9270b5 tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:19 devstack sudo[89430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4 1G Apr 07 06:14:19 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:19 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4f344885-5b64-4294-9d22-e14f3e9270b5 tempest-VolumesExtendTest-151415834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4 1G" returned: 0 in 0.465s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4f344885-5b64-4294-9d22-e14f3e9270b5 tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:19 devstack sudo[89435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4 Apr 07 06:14:19 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:20 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4f344885-5b64-4294-9d22-e14f3e9270b5 tempest-VolumesExtendTest-151415834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4" returned: 0 in 0.428s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:20 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-4f344885-5b64-4294-9d22-e14f3e9270b5 tempest-VolumesExtendTest-151415834 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4 is being set with open permissions: ugo+rw Apr 07 06:14:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4f344885-5b64-4294-9d22-e14f3e9270b5 tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:20 devstack sudo[89441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4 Apr 07 06:14:20 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:20 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] Acquiring lock "cinder-ad6170fe-e950-491b-84b2-e55fab157a13-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:20 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] Lock "cinder-ad6170fe-e950-491b-84b2-e55fab157a13-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:20 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] Acquiring lock "cinder-quobyte-ad6170fe-e950-491b-84b2-e55fab157a13" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:20 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] Lock "cinder-quobyte-ad6170fe-e950-491b-84b2-e55fab157a13" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:20 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8137403-6344-4c4e-ab28-a815e9907814]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:20 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13 Apr 07 06:14:20 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:20 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4f344885-5b64-4294-9d22-e14f3e9270b5 tempest-VolumesExtendTest-151415834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4" returned: 0 in 0.481s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4f344885-5b64-4294-9d22-e14f3e9270b5 tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:20 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.info Apr 07 06:14:20 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:20 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13" returned: 0 in 0.496s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:20 devstack sudo[89451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13 Apr 07 06:14:20 devstack sudo[89451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:21 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4f344885-5b64-4294-9d22-e14f3e9270b5 tempest-VolumesExtendTest-151415834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.info" returned: 0 in 0.437s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:21 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-4f344885-5b64-4294-9d22-e14f3e9270b5 tempest-VolumesExtendTest-151415834 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.info is being set with open permissions: ugo+rw Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4f344885-5b64-4294-9d22-e14f3e9270b5 tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:21 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.info Apr 07 06:14:21 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:21 devstack sudo[89451]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ad6170fe-e950-491b-84b2-e55fab157a13" returned: 0 in 0.442s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] Lock "cinder-quobyte-ad6170fe-e950-491b-84b2-e55fab157a13" released by "delete_volume" :: held 0.974s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] Created reservations ['be612b2a-009f-4508-aa81-1eb640de566b', 'c9e6f7da-735b-4568-bc3d-03ae347a9803', 'e8958eb3-9a92-40ce-bfe7-010402411ade', 'd278567f-549c-4e47-89d8-3cbecbf765ed'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:21 devstack sudo[89457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:14:21 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:21 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4f344885-5b64-4294-9d22-e14f3e9270b5 tempest-VolumesExtendTest-151415834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.info" returned: 0 in 0.466s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4f344885-5b64-4294-9d22-e14f3e9270b5 tempest-VolumesExtendTest-151415834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.822s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:21 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-4f344885-5b64-4294-9d22-e14f3e9270b5 tempest-VolumesExtendTest-151415834 None] Create snapshot completed successfully Apr 07 06:14:21 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.417s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:21 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] Deleted volume successfully. Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4ad66f30-5d66-4b3e-9080-49378e4267ca tempest-CinderUnicodeTest-160813220 None] Lock "cinder-ad6170fe-e950-491b-84b2-e55fab157a13-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a59dee84-c482-4699-b86f-afd585640405 tempest-VolumesExtendTest-151415834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a59dee84-c482-4699-b86f-afd585640405 tempest-VolumesExtendTest-151415834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb51acf-6764-4ffb-b1d0-24ee76962a53]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a59dee84-c482-4699-b86f-afd585640405 tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:21 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf Apr 07 06:14:21 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:22 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a59dee84-c482-4699-b86f-afd585640405 tempest-VolumesExtendTest-151415834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf" returned: 0 in 0.454s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a59dee84-c482-4699-b86f-afd585640405 tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4 2G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] Acquiring lock "cinder-75d35c4f-8d19-4998-b746-b5084845da93-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] Lock "cinder-75d35c4f-8d19-4998-b746-b5084845da93-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] Acquiring lock "cinder-quobyte-75d35c4f-8d19-4998-b746-b5084845da93" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] Lock "cinder-quobyte-75d35c4f-8d19-4998-b746-b5084845da93" acquired by "delete_volume" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-a59dee84-c482-4699-b86f-afd585640405 tempest-VolumesExtendTest-151415834 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4 2G" returned: 0 in 0.081s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-a59dee84-c482-4699-b86f-afd585640405 tempest-VolumesExtendTest-151415834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.551s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:22 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcb1116-5a96-4b60-b0d3-fedc740b98aa]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-75d35c4f-8d19-4998-b746-b5084845da93 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:22 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-a59dee84-c482-4699-b86f-afd585640405 tempest-VolumesExtendTest-151415834 None] Extend volume completed successfully. Apr 07 06:14:22 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-75d35c4f-8d19-4998-b746-b5084845da93 Apr 07 06:14:22 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:22 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-75d35c4f-8d19-4998-b746-b5084845da93" returned: 0 in 0.444s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-75d35c4f-8d19-4998-b746-b5084845da93 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:22 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-75d35c4f-8d19-4998-b746-b5084845da93 Apr 07 06:14:22 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] Acquiring lock "cinder-532a9193-20b4-49a7-9cca-aa73eff673d4-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] Lock "cinder-532a9193-20b4-49a7-9cca-aa73eff673d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] Acquiring lock "cinder-quobyte-e6e3451f-c07d-4775-b03c-f1572efb8fdf" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] Lock "cinder-quobyte-e6e3451f-c07d-4775-b03c-f1572efb8fdf" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] Acquiring lock "cinder-quobyte-532a9193-20b4-49a7-9cca-aa73eff673d4" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] Lock "cinder-quobyte-532a9193-20b4-49a7-9cca-aa73eff673d4" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] Deleting offline snapshot 532a9193-20b4-49a7-9cca-aa73eff673d4 of volume e6e3451f-c07d-4775-b03c-f1572efb8fdf {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] snapshot_file for this snap is: volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8444b20-e782-46c6-bc24-b9ccdcf11405]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:23 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4 Apr 07 06:14:23 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:23 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-75d35c4f-8d19-4998-b746-b5084845da93" returned: 0 in 0.413s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] Lock "cinder-quobyte-75d35c4f-8d19-4998-b746-b5084845da93" released by "delete_volume" :: held 0.876s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] Created reservations ['ae2d45e8-9062-4d3b-925c-27b348238d2f', 'df96e101-2c79-47aa-8eac-ebf691255851', 'e0e4410e-c8e1-4625-9eef-224ccd8ac286', '4f26999b-7ffd-4a2a-8071-f5f82a1e1430'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:23 devstack sudo[89479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:14:23 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:23 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4" returned: 0 in 0.514s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[faecf24f-7e45-4a4a-b40e-cd4b25b8ad58]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:23 devstack sudo[89484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf Apr 07 06:14:23 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:23 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.444s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:23 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] Deleted volume successfully. Apr 07 06:14:23 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b666ad4c-1e13-4547-9562-2da1086f6686 tempest-CinderUnicodeTest-160813220 None] Lock "cinder-75d35c4f-8d19-4998-b746-b5084845da93-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:24 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf" returned: 0 in 0.527s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:24 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4 Apr 07 06:14:24 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:24 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4" returned: 0 in 0.522s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:24 devstack sudo[89495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4 Apr 07 06:14:24 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:25 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf.532a9193-20b4-49a7-9cca-aa73eff673d4" returned: 0 in 0.444s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:25 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] Lock "cinder-quobyte-532a9193-20b4-49a7-9cca-aa73eff673d4" released by "_delete_snapshot" :: held 2.085s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:25 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] Lock "cinder-quobyte-e6e3451f-c07d-4775-b03c-f1572efb8fdf" released by "delete_snapshot" :: held 2.104s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:25 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] Created reservations ['75cf203f-7fdf-4e50-b7c5-fab08024306d', 'b179a316-9c44-46d4-ae61-b990c61e0ec3', '94e91842-c334-4369-8986-9631bc9809ba', '156aa9d0-e236-4461-85a6-dc08ef35eb08'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:25 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] Delete snapshot completed successfully. Apr 07 06:14:25 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-76cd702e-3033-421a-89c9-0ab6da286854 tempest-VolumesExtendTest-151415834 None] Lock "cinder-532a9193-20b4-49a7-9cca-aa73eff673d4-delete_snapshot" released by "delete_snapshot" :: held 2.217s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] Acquiring lock "cinder-e6e3451f-c07d-4775-b03c-f1572efb8fdf-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] Lock "cinder-e6e3451f-c07d-4775-b03c-f1572efb8fdf-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] Acquiring lock "cinder-quobyte-e6e3451f-c07d-4775-b03c-f1572efb8fdf" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:26 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] Lock "cinder-quobyte-e6e3451f-c07d-4775-b03c-f1572efb8fdf" acquired by "delete_volume" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:26 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc80c33c-4477-4117-bb90-a1b5ae631b67]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:26 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf Apr 07 06:14:26 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:26 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf" returned: 0 in 0.513s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:26 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf Apr 07 06:14:26 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:27 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-e6e3451f-c07d-4775-b03c-f1572efb8fdf" returned: 0 in 0.433s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] Lock "cinder-quobyte-e6e3451f-c07d-4775-b03c-f1572efb8fdf" released by "delete_volume" :: held 0.991s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:27 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] Created reservations ['59a84885-a7a6-4743-b7bd-60e6bb2744c3', 'dbc02817-30c9-4b5f-bacc-04c12872df4e', '82b6301b-8b69-419e-ad55-d4f12683f6e1', 'e5d01889-0ce8-4262-bec1-1416568a8c18'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:27 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:27 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:27 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:14:27 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:27 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.430s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:27 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:27 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] Deleted volume successfully. Apr 07 06:14:27 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b2947c3b-f61e-4597-ac36-8e7a7a7666ae tempest-VolumesExtendTest-151415834 None] Lock "cinder-e6e3451f-c07d-4775-b03c-f1572efb8fdf-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Flow 'volume_create_manager' (579de375-4ce4-48b2-8e4d-d970e85e5446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f4b9b5-b579-4228-88e4-84294870b8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f4b9b5-b579-4228-88e4-84294870b8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-471509575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aeb6fe5-0959-4560-ba30-2db1dbcd78d3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7c0360931b99417bbe7d139e82a5231c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:30Z,use_quota=True,user_id='71e686e9c6cd468883c310b682aab307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1486044a-79b7-4f91-8de4-b4a9a271d39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1486044a-79b7-4f91-8de4-b4a9a271d39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea914d9e-64bd-4d00-8bb3-b40419f93719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea914d9e-64bd-4d00-8bb3-b40419f93719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aeb6fe5-0959-4560-ba30-2db1dbcd78d3', 'volume_name': 'volume-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97ad32d-f121-4b75-87a9-e2d55eea3d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97ad32d-f121-4b75-87a9-e2d55eea3d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0bd5db1-6d47-48ed-ac1a-5e965c28db2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:30 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Volume 0aeb6fe5-0959-4560-ba30-2db1dbcd78d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3', 'volume_size': 1} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-471509575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aeb6fe5-0959-4560-ba30-2db1dbcd78d3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7c0360931b99417bbe7d139e82a5231c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:30Z,use_quota=True,user_id='71e686e9c6cd468883c310b682aab307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Creating volume 0aeb6fe5-0959-4560-ba30-2db1dbcd78d3 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:30 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:30 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3 1073741824 Apr 07 06:14:30 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:30 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3 1073741824" returned: 0 in 0.618s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:31 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3 Apr 07 06:14:31 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:31 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3" returned: 0 in 0.470s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:14:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:31 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0bd5db1-6d47-48ed-ac1a-5e965c28db2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:31 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c845521b-54b8-4819-8559-9d25846d7a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:31 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Volume volume-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3 (0aeb6fe5-0959-4560-ba30-2db1dbcd78d3): created successfully Apr 07 06:14:31 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c845521b-54b8-4819-8559-9d25846d7a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:31 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Flow 'volume_create_manager' (579de375-4ce4-48b2-8e4d-d970e85e5446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:31 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-374bfab5-6ccf-41fd-80e7-cc46a1c04c8c tempest-VolumesGetTest-470092308 None] Created volume successfully. Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Flow 'volume_create_manager' (700d0140-3509-4fd0-8305-2d207e3008c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701b471b-3ed3-4917-a477-ce825670f1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701b471b-3ed3-4917-a477-ce825670f1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-497499317',display_name='tempest-VolumesGetTest-Volume-1481636270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbead222-7f42-4530-86b8-87d3b5ed3128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0360931b99417bbe7d139e82a5231c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:33Z,use_quota=True,user_id='71e686e9c6cd468883c310b682aab307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd8b25c-68e5-4871-aa04-d4f5a82aaad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd8b25c-68e5-4871-aa04-d4f5a82aaad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e96606-11b6-437f-847f-fac2760413cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e96606-11b6-437f-847f-fac2760413cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbead222-7f42-4530-86b8-87d3b5ed3128', 'volume_name': 'volume-bbead222-7f42-4530-86b8-87d3b5ed3128', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f08a35a-8d82-4d31-a2ef-6f89e354d5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f08a35a-8d82-4d31-a2ef-6f89e354d5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0add88ce-5d83-4c2d-8c16-9287c2ccfc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:32 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Volume bbead222-7f42-4530-86b8-87d3b5ed3128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbead222-7f42-4530-86b8-87d3b5ed3128', 'volume_size': 1} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-497499317',display_name='tempest-VolumesGetTest-Volume-1481636270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbead222-7f42-4530-86b8-87d3b5ed3128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0360931b99417bbe7d139e82a5231c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:33Z,use_quota=True,user_id='71e686e9c6cd468883c310b682aab307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Creating volume bbead222-7f42-4530-86b8-87d3b5ed3128 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:32 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:14:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bbead222-7f42-4530-86b8-87d3b5ed3128 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:33 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bbead222-7f42-4530-86b8-87d3b5ed3128 1073741824 Apr 07 06:14:33 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:33 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bbead222-7f42-4530-86b8-87d3b5ed3128 1073741824" returned: 0 in 0.664s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bbead222-7f42-4530-86b8-87d3b5ed3128 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:33 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bbead222-7f42-4530-86b8-87d3b5ed3128 Apr 07 06:14:33 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:34 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bbead222-7f42-4530-86b8-87d3b5ed3128" returned: 0 in 0.532s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:34 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:14:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0add88ce-5d83-4c2d-8c16-9287c2ccfc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbead222-7f42-4530-86b8-87d3b5ed3128', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41097f44-e0db-44ea-aae8-76e2975e9206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:34 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Volume volume-bbead222-7f42-4530-86b8-87d3b5ed3128 (bbead222-7f42-4530-86b8-87d3b5ed3128): created successfully Apr 07 06:14:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41097f44-e0db-44ea-aae8-76e2975e9206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Flow 'volume_create_manager' (700d0140-3509-4fd0-8305-2d207e3008c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:34 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-21e4302a-fb41-4b99-84e8-df126ab24365 tempest-VolumesGetTest-470092308 None] Created volume successfully. Apr 07 06:14:35 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] Acquiring lock "cinder-bbead222-7f42-4530-86b8-87d3b5ed3128-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:35 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] Lock "cinder-bbead222-7f42-4530-86b8-87d3b5ed3128-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:35 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] Acquiring lock "cinder-quobyte-bbead222-7f42-4530-86b8-87d3b5ed3128" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:35 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] Lock "cinder-quobyte-bbead222-7f42-4530-86b8-87d3b5ed3128" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:35 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb99d053-da08-4e5d-9e6c-011eac4fb17c]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bbead222-7f42-4530-86b8-87d3b5ed3128 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:35 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bbead222-7f42-4530-86b8-87d3b5ed3128 Apr 07 06:14:35 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:35 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bbead222-7f42-4530-86b8-87d3b5ed3128" returned: 0 in 0.634s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bbead222-7f42-4530-86b8-87d3b5ed3128 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:35 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bbead222-7f42-4530-86b8-87d3b5ed3128 Apr 07 06:14:35 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:36 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-bbead222-7f42-4530-86b8-87d3b5ed3128" returned: 0 in 0.540s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:36 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] Lock "cinder-quobyte-bbead222-7f42-4530-86b8-87d3b5ed3128" released by "delete_volume" :: held 1.199s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:36 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] Created reservations ['ba7978aa-15d6-44f5-a72a-9a475f4c5858', '59dde062-40a1-43da-a3a4-accfd98c98c9', '56dcd667-fb05-4c0c-90a6-41b66a2921a8', 'cafa04e6-e8fc-4555-8bbe-dd511a6ff25e'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:36 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:14:36 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:37 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.457s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:37 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:37 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] Deleted volume successfully. Apr 07 06:14:37 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d0213257-19e6-4f36-85b8-dbff02197bd1 tempest-VolumesGetTest-470092308 None] Lock "cinder-bbead222-7f42-4530-86b8-87d3b5ed3128-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:37 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] Acquiring lock "cinder-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:37 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] Lock "cinder-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:37 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] Acquiring lock "cinder-quobyte-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:37 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] Lock "cinder-quobyte-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3" acquired by "delete_volume" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:37 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f3e0d2-b178-47d0-ba64-1063cdd639c5]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:37 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3 Apr 07 06:14:37 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:38 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3" returned: 0 in 0.526s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:38 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3 Apr 07 06:14:38 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:38 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3" returned: 0 in 0.499s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] Lock "cinder-quobyte-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3" released by "delete_volume" :: held 1.052s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] Created reservations ['e279d6d1-1852-4e7b-8357-907a17b3f99c', '2ea22914-2bb0-4be3-b054-603b0cd5c416', '3dcae927-7f24-4582-b5ce-40f74644bc4c', 'fec5152c-36a7-492f-9323-e634f40e0408'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:38 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:14:38 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Flow 'volume_create_manager' (0f3b557c-41e5-49ff-bfb5-7fb1cf26c813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92288fda-d081-4927-a601-7eaf95623d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92288fda-d081-4927-a601-7eaf95623d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1255746069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03266a3e-5eb2-43d8-9951-93574a83bba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdf6c9f77f144a6a19e053f96de8933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:39Z,use_quota=True,user_id='106395418eac4c88bcc0ea4da5335149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045e6495-e2f1-4ca8-b368-88ace6acedcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045e6495-e2f1-4ca8-b368-88ace6acedcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e31b8d1-1cc1-48d6-b7fd-6657c04d0d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e31b8d1-1cc1-48d6-b7fd-6657c04d0d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03266a3e-5eb2-43d8-9951-93574a83bba0', 'volume_name': 'volume-03266a3e-5eb2-43d8-9951-93574a83bba0', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8af50cf-b1f9-4fdd-adcd-4eabc4516544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8af50cf-b1f9-4fdd-adcd-4eabc4516544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac849d95-21d8-4b1a-ad8d-670566f25fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:38 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Volume 03266a3e-5eb2-43d8-9951-93574a83bba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03266a3e-5eb2-43d8-9951-93574a83bba0', 'volume_size': 1} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1255746069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03266a3e-5eb2-43d8-9951-93574a83bba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdf6c9f77f144a6a19e053f96de8933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:39Z,use_quota=True,user_id='106395418eac4c88bcc0ea4da5335149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Creating volume 03266a3e-5eb2-43d8-9951-93574a83bba0 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:38 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:14:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:38 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 1073741824 Apr 07 06:14:38 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:39 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.543s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:39 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] Deleted volume successfully. Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-5d869081-57b0-4ac2-bafa-d5c68939d517 tempest-VolumesGetTest-470092308 None] Lock "cinder-0aeb6fe5-0959-4560-ba30-2db1dbcd78d3-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:39 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 1073741824" returned: 0 in 0.543s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:39 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 Apr 07 06:14:39 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:39 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Flow 'volume_create_manager' (a5ff6646-310c-4dff-b14f-651a78ab1a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a854373-86a1-4c85-8f8b-ee260bc9ae17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0" returned: 0 in 0.477s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a854373-86a1-4c85-8f8b-ee260bc9ae17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1746517586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73d29ca-611b-494b-9891-8f7234d7be38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0360931b99417bbe7d139e82a5231c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:40Z,use_quota=True,user_id='71e686e9c6cd468883c310b682aab307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2bf9aa5-d14d-4cc4-b489-430f95c59db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2bf9aa5-d14d-4cc4-b489-430f95c59db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778c45be-f6dc-4d7c-98b8-812994ef0ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778c45be-f6dc-4d7c-98b8-812994ef0ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c73d29ca-611b-494b-9891-8f7234d7be38', 'volume_name': 'volume-c73d29ca-611b-494b-9891-8f7234d7be38', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c130e1-2e67-4db0-9b88-b2bb1d9320fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c130e1-2e67-4db0-9b88-b2bb1d9320fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a5e5b3-c4ce-4091-bde1-255a8ec8f83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:39 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Volume c73d29ca-611b-494b-9891-8f7234d7be38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c73d29ca-611b-494b-9891-8f7234d7be38', 'volume_size': 1} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1746517586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73d29ca-611b-494b-9891-8f7234d7be38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0360931b99417bbe7d139e82a5231c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:40Z,use_quota=True,user_id='71e686e9c6cd468883c310b682aab307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Creating volume c73d29ca-611b-494b-9891-8f7234d7be38 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:39 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac849d95-21d8-4b1a-ad8d-670566f25fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03266a3e-5eb2-43d8-9951-93574a83bba0', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:39 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 1073741824 Apr 07 06:14:39 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e212560b-62e1-4095-92dc-3aa482d04b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:39 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Volume volume-03266a3e-5eb2-43d8-9951-93574a83bba0 (03266a3e-5eb2-43d8-9951-93574a83bba0): created successfully Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e212560b-62e1-4095-92dc-3aa482d04b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:39 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Flow 'volume_create_manager' (0f3b557c-41e5-49ff-bfb5-7fb1cf26c813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:39 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-687cc831-e4d2-4fa7-b415-65670eb23e6f tempest-SnapshotDependencyTests-1641990033 None] Created volume successfully. Apr 07 06:14:40 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 1073741824" returned: 0 in 0.455s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:40 devstack sudo[89567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 Apr 07 06:14:40 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:40 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38" returned: 0 in 0.370s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:14:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a5e5b3-c4ce-4091-bde1-255a8ec8f83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73d29ca-611b-494b-9891-8f7234d7be38', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a8814d-bcf9-4f29-9cc9-7db99a159c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:40 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Volume volume-c73d29ca-611b-494b-9891-8f7234d7be38 (c73d29ca-611b-494b-9891-8f7234d7be38): created successfully Apr 07 06:14:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a8814d-bcf9-4f29-9cc9-7db99a159c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:40 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Flow 'volume_create_manager' (a5ff6646-310c-4dff-b14f-651a78ab1a99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:40 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-4ddec965-efc0-4412-a5dc-d23bd6a6b189 tempest-VolumesGetTest-470092308 None] Created volume successfully. Apr 07 06:14:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9a2c14da-e191-4389-b609-25d2a958894a tempest-SnapshotDependencyTests-1641990033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9a2c14da-e191-4389-b609-25d2a958894a tempest-SnapshotDependencyTests-1641990033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-9a2c14da-e191-4389-b609-25d2a958894a tempest-SnapshotDependencyTests-1641990033 None] Creating offline snapshot 875bbf39-0292-42cb-a10f-f235330de4b1 of volume 03266a3e-5eb2-43d8-9951-93574a83bba0 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:14:41 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b275a97-c13c-4ed5-abfb-4129b2101b4a]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9a2c14da-e191-4389-b609-25d2a958894a tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:41 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 Apr 07 06:14:41 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:41 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Flow 'volume_create_manager' (21a77cdd-2531-4cc7-ac37-ce574d1c0629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4135776-c5e3-4523-84f3-507c40c62295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4135776-c5e3-4523-84f3-507c40c62295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-570411688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7c0360931b99417bbe7d139e82a5231c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c73d29ca-611b-494b-9891-8f7234d7be38,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:41Z,use_quota=True,user_id='71e686e9c6cd468883c310b682aab307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fad30a2-0c1b-4cd0-b882-dea3d2f82ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fad30a2-0c1b-4cd0-b882-dea3d2f82ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630f0130-bd9e-4a8e-96db-f90e7cd766c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630f0130-bd9e-4a8e-96db-f90e7cd766c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0', 'volume_name': 'volume-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0', 'volume_size': 1, 'source_volid': 'c73d29ca-611b-494b-9891-8f7234d7be38', 'source_volstatus': 'available'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e1c8e6-b37b-414f-b9a9-675d326c780e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e1c8e6-b37b-414f-b9a9-675d326c780e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401067b4-2c9f-4798-87df-f40616790ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:41 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Volume fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0', 'volume_size': 1, 'source_volid': 'c73d29ca-611b-494b-9891-8f7234d7be38', 'source_volstatus': 'available'} Apr 07 06:14:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:41 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9a2c14da-e191-4389-b609-25d2a958894a tempest-SnapshotDependencyTests-1641990033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0" returned: 0 in 0.447s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9a2c14da-e191-4389-b609-25d2a958894a tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:41 devstack sudo[89575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1 1G Apr 07 06:14:41 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:41 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9a2c14da-e191-4389-b609-25d2a958894a tempest-SnapshotDependencyTests-1641990033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1 1G" returned: 0 in 0.444s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9a2c14da-e191-4389-b609-25d2a958894a tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03266a3e-5eb2-43d8-9951-93574a83bba0 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:41 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03266a3e-5eb2-43d8-9951-93574a83bba0 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1 Apr 07 06:14:41 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:42 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9a2c14da-e191-4389-b609-25d2a958894a tempest-SnapshotDependencyTests-1641990033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03266a3e-5eb2-43d8-9951-93574a83bba0 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1" returned: 0 in 0.396s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:42 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-9a2c14da-e191-4389-b609-25d2a958894a tempest-SnapshotDependencyTests-1641990033 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1 is being set with open permissions: ugo+rw Apr 07 06:14:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9a2c14da-e191-4389-b609-25d2a958894a tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:42 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1 Apr 07 06:14:42 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:42 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9a2c14da-e191-4389-b609-25d2a958894a tempest-SnapshotDependencyTests-1641990033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1" returned: 0 in 0.374s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9a2c14da-e191-4389-b609-25d2a958894a tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:42 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.info Apr 07 06:14:42 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:43 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9a2c14da-e191-4389-b609-25d2a958894a tempest-SnapshotDependencyTests-1641990033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.info" returned: 0 in 0.388s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:43 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-9a2c14da-e191-4389-b609-25d2a958894a tempest-SnapshotDependencyTests-1641990033 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.info is being set with open permissions: ugo+rw Apr 07 06:14:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9a2c14da-e191-4389-b609-25d2a958894a tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:43 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.info Apr 07 06:14:43 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:43 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-9a2c14da-e191-4389-b609-25d2a958894a tempest-SnapshotDependencyTests-1641990033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.info" returned: 0 in 0.371s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-9a2c14da-e191-4389-b609-25d2a958894a tempest-SnapshotDependencyTests-1641990033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.477s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.181s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:43 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Cloning volume c73d29ca-611b-494b-9891-8f7234d7be38 to volume fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0 Apr 07 06:14:43 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-9a2c14da-e191-4389-b609-25d2a958894a tempest-SnapshotDependencyTests-1641990033 None] Create snapshot completed successfully Apr 07 06:14:43 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Creating offline snapshot 0ab8aada-fbe2-4142-a39b-1a61ff2c5125 of volume c73d29ca-611b-494b-9891-8f7234d7be38 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:14:43 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ee4bde-0969-4880-b81a-feff869504ca]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:43 devstack sudo[89594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 Apr 07 06:14:43 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:43 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38" returned: 0 in 0.443s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:43 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125 1G Apr 07 06:14:43 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:44 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:44 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125 1G" returned: 0 in 0.516s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c73d29ca-611b-494b-9891-8f7234d7be38 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:44 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c73d29ca-611b-494b-9891-8f7234d7be38 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125 Apr 07 06:14:44 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:44 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Flow 'volume_create_manager' (260cab7e-b02e-48f3-902c-aa1a9bd4e68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:44 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7217889-40e4-4a9d-a90e-f2960f6e5282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:44 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7217889-40e4-4a9d-a90e-f2960f6e5282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d3d5c1-a065-46b9-9e21-982802a25b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdf6c9f77f144a6a19e053f96de8933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=875bbf39-0292-42cb-a10f-f235330de4b1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:44Z,use_quota=True,user_id='106395418eac4c88bcc0ea4da5335149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:44 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155f8eff-c9f3-45cb-979c-b67b73745f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:44 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155f8eff-c9f3-45cb-979c-b67b73745f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:44 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0120334b-5682-4c87-bdbe-7cafdd966ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:44 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0120334b-5682-4c87-bdbe-7cafdd966ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '70d3d5c1-a065-46b9-9e21-982802a25b8a', 'volume_name': 'volume-70d3d5c1-a065-46b9-9e21-982802a25b8a', 'volume_size': 1, 'snapshot_id': '875bbf39-0292-42cb-a10f-f235330de4b1'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:44 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f16ae48-49b0-4085-8a36-a114cc9375d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:44 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f16ae48-49b0-4085-8a36-a114cc9375d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:44 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d104931-39d7-4c61-8ebd-f5d8428abf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:44 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Volume 70d3d5c1-a065-46b9-9e21-982802a25b8a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-70d3d5c1-a065-46b9-9e21-982802a25b8a', 'volume_size': 1, 'snapshot_id': '875bbf39-0292-42cb-a10f-f235330de4b1'} Apr 07 06:14:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:44 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c73d29ca-611b-494b-9891-8f7234d7be38 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125" returned: 0 in 0.452s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:44 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125 is being set with open permissions: ugo+rw Apr 07 06:14:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:44 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125 Apr 07 06:14:44 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:45 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125" returned: 0 in 0.443s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:45 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.info Apr 07 06:14:45 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:45 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.info" returned: 0 in 0.431s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:45 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.info is being set with open permissions: ugo+rw Apr 07 06:14:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:45 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.info Apr 07 06:14:45 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:46 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.info" returned: 0 in 0.403s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:46 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Acquiring lock "cinder-quobyte-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0" by "_copy_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:46 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Lock "cinder-quobyte-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] snapshot: 0ab8aada-fbe2-4142-a39b-1a61ff2c5125, volume: fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0, {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:14:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:46 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7ad2ae-9856-4ffc-8dc7-03be9a705070]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:46 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125 Apr 07 06:14:46 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:46 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125" returned: 0 in 0.528s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c73d29ca-611b-494b-9891-8f7234d7be38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:14:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] will copy from snapshot at /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:14:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Creating direct copy from snapshot {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:14:46 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[a437cc42-9afb-428f-b744-baed79621083]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:46 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 Apr 07 06:14:46 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:47 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38" returned: 0 in 0.429s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:47 devstack cinder-volume[82475]: DEBUG cinder.utils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Path /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0 not found in is_blk_device check {{(pid=82475) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:14:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:47 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0 Apr 07 06:14:47 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:49 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0" returned: 0 in 1.797s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:49 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab59ca09-5cbd-42a0-b352-55fe30834fb9]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:49 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 Apr 07 06:14:49 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:49 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38" returned: 0 in 0.539s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:49 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Image conversion details: src /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38, size 1024.00 MB, duration 1.80 sec, destination /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0 {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:14:49 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Converted 1024.00 MB image at 569.56 MB/s Apr 07 06:14:49 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0 is being set with open permissions: ugo+rw Apr 07 06:14:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:49 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0 Apr 07 06:14:49 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:49 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0" returned: 0 in 0.400s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:49 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Lock "cinder-quobyte-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0" released by "_copy_volume_from_snapshot" :: held 3.740s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Acquiring lock "cinder-quobyte-0ab8aada-fbe2-4142-a39b-1a61ff2c5125" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Lock "cinder-quobyte-0ab8aada-fbe2-4142-a39b-1a61ff2c5125" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:50 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Deleting offline snapshot 0ab8aada-fbe2-4142-a39b-1a61ff2c5125 of volume c73d29ca-611b-494b-9891-8f7234d7be38 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:14:50 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] snapshot_file for this snap is: volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:14:50 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ee9648-0c02-491c-8608-f698f555f752]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:50 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125 Apr 07 06:14:50 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:50 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125" returned: 0 in 0.456s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:50 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c73d29ca-611b-494b-9891-8f7234d7be38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:14:50 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[7864d9e9-6f4c-4bc5-b57a-e8ac148bfcd5]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:50 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 Apr 07 06:14:50 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:50 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38" returned: 0 in 0.457s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:50 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125 Apr 07 06:14:50 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:51 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125" returned: 0 in 0.429s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:51 devstack sudo[89664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125 Apr 07 06:14:51 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:51 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38.0ab8aada-fbe2-4142-a39b-1a61ff2c5125" returned: 0 in 0.423s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Lock "cinder-quobyte-0ab8aada-fbe2-4142-a39b-1a61ff2c5125" released by "_delete_snapshot" :: held 1.808s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG oslo_service.periodic_task [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82475) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:51 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:14:51 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.377s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.300s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Acquiring lock "cinder-quobyte-875bbf39-0292-42cb-a10f-f235330de4b1-70d3d5c1-a065-46b9-9e21-982802a25b8a" by "_create_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401067b4-2c9f-4798-87df-f40616790ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0', 'volume_size': 1, 'source_volid': 'c73d29ca-611b-494b-9891-8f7234d7be38', 'source_volstatus': 'available'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f5fb79d-2306-42de-98a7-28bba2a8a1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Lock "cinder-quobyte-875bbf39-0292-42cb-a10f-f235330de4b1-70d3d5c1-a065-46b9-9e21-982802a25b8a" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Creating volume 70d3d5c1-a065-46b9-9e21-982802a25b8a from snapshot 875bbf39-0292-42cb-a10f-f235330de4b1 {{(pid=82475) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Acquiring lock "cinder-quobyte-70d3d5c1-a065-46b9-9e21-982802a25b8a" by "_copy_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:51 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Volume volume-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0 (fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0): created successfully Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f5fb79d-2306-42de-98a7-28bba2a8a1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Flow 'volume_create_manager' (21a77cdd-2531-4cc7-ac37-ce574d1c0629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Lock "cinder-quobyte-70d3d5c1-a065-46b9-9e21-982802a25b8a" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] snapshot: 875bbf39-0292-42cb-a10f-f235330de4b1, volume: 70d3d5c1-a065-46b9-9e21-982802a25b8a, {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:51 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-14aaf476-2169-474c-aa10-a4ff19cdee9b tempest-VolumesGetTest-470092308 None] Created volume successfully. Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0c20f0-a1d5-405b-9396-58e20983e337]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:52 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1 Apr 07 06:14:52 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:52 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.402s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:52 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:52 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1" returned: 0 in 0.439s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03266a3e-5eb2-43d8-9951-93574a83bba0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:14:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] will copy from snapshot at /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:14:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Creating direct copy from snapshot {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:14:52 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f94044-aecc-443d-b799-eb260ae2868c]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:52 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 Apr 07 06:14:52 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:52 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0" returned: 0 in 0.476s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:52 devstack cinder-volume[82475]: DEBUG cinder.utils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Path /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d3d5c1-a065-46b9-9e21-982802a25b8a not found in is_blk_device check {{(pid=82475) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:14:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d3d5c1-a065-46b9-9e21-982802a25b8a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:52 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d3d5c1-a065-46b9-9e21-982802a25b8a Apr 07 06:14:52 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:53 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:14:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Flow 'volume_create_manager' (bd6df3f7-e55b-4727-abc0-17116af02756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f6ace9-650e-43fe-b43f-92737040638c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f6ace9-650e-43fe-b43f-92737040638c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-177162166',display_name='tempest-VolumesGetTest-Volume-166735374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0360931b99417bbe7d139e82a5231c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:53Z,use_quota=True,user_id='71e686e9c6cd468883c310b682aab307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3aa45f-931c-46a3-9fe8-f83243fd7b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3aa45f-931c-46a3-9fe8-f83243fd7b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f700479-c946-4a42-b7e6-085f92a4ea33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f700479-c946-4a42-b7e6-085f92a4ea33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0', 'volume_name': 'volume-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5eab0a-b4d2-4ffa-8be0-710441d6ebb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5eab0a-b4d2-4ffa-8be0-710441d6ebb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4efca791-0dc0-4ac6-ab99-a2d6f6b99e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:53 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Volume 8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0', 'volume_size': 1} Apr 07 06:14:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:54 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d3d5c1-a065-46b9-9e21-982802a25b8a" returned: 0 in 1.994s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:54 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[745c7b06-af55-462a-a847-94c5ed4dfd05]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:54 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 Apr 07 06:14:54 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:55 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0" returned: 0 in 0.591s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Image conversion details: src /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0, size 1024.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d3d5c1-a065-46b9-9e21-982802a25b8a {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:14:55 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Converted 1024.00 MB image at 513.20 MB/s Apr 07 06:14:55 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d3d5c1-a065-46b9-9e21-982802a25b8a is being set with open permissions: ugo+rw Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d3d5c1-a065-46b9-9e21-982802a25b8a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:55 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d3d5c1-a065-46b9-9e21-982802a25b8a Apr 07 06:14:55 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:55 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d3d5c1-a065-46b9-9e21-982802a25b8a" returned: 0 in 0.416s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Lock "cinder-quobyte-70d3d5c1-a065-46b9-9e21-982802a25b8a" released by "_copy_volume_from_snapshot" :: held 3.974s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Lock "cinder-quobyte-875bbf39-0292-42cb-a10f-f235330de4b1-70d3d5c1-a065-46b9-9e21-982802a25b8a" released by "_create_volume_from_snapshot" :: held 4.005s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.027s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.247s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:14:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-177162166',display_name='tempest-VolumesGetTest-Volume-166735374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0360931b99417bbe7d139e82a5231c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:14:53Z,use_quota=True,user_id='71e686e9c6cd468883c310b682aab307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Creating volume 8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:14:55 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:55 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0 1073741824 Apr 07 06:14:55 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d104931-39d7-4c61-8ebd-f5d8428abf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70d3d5c1-a065-46b9-9e21-982802a25b8a', 'volume_size': 1, 'snapshot_id': '875bbf39-0292-42cb-a10f-f235330de4b1'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41bb1c2e-d91a-4d44-a8b0-08cf7a0191f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:55 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Volume volume-70d3d5c1-a065-46b9-9e21-982802a25b8a (70d3d5c1-a065-46b9-9e21-982802a25b8a): created successfully Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41bb1c2e-d91a-4d44-a8b0-08cf7a0191f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Flow 'volume_create_manager' (260cab7e-b02e-48f3-902c-aa1a9bd4e68d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:55 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-43c58a39-887a-4929-8969-a49b66d392a0 tempest-SnapshotDependencyTests-1641990033 None] Created volume successfully. Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] Acquiring lock "cinder-875bbf39-0292-42cb-a10f-f235330de4b1-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] Lock "cinder-875bbf39-0292-42cb-a10f-f235330de4b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] Acquiring lock "cinder-quobyte-03266a3e-5eb2-43d8-9951-93574a83bba0" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] Lock "cinder-quobyte-03266a3e-5eb2-43d8-9951-93574a83bba0" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] Acquiring lock "cinder-quobyte-875bbf39-0292-42cb-a10f-f235330de4b1" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] Lock "cinder-quobyte-875bbf39-0292-42cb-a10f-f235330de4b1" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] Deleting offline snapshot 875bbf39-0292-42cb-a10f-f235330de4b1 of volume 03266a3e-5eb2-43d8-9951-93574a83bba0 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] snapshot_file for this snap is: volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eae6b7a-0d64-4753-903d-e1ff2845b3e0]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:56 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1 Apr 07 06:14:56 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:56 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0 1073741824" returned: 0 in 0.564s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:56 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0 Apr 07 06:14:56 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:56 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1" returned: 0 in 0.537s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03266a3e-5eb2-43d8-9951-93574a83bba0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ae8777-990f-4527-8570-02d8af1e3ef2]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:56 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0" returned: 0 in 0.446s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4efca791-0dc0-4ac6-ab99-a2d6f6b99e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:56 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a23987-fd8d-4c43-9fd2-b884acd28ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:14:56 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:56 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Volume volume-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0 (8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0): created successfully Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a23987-fd8d-4c43-9fd2-b884acd28ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:14:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Flow 'volume_create_manager' (bd6df3f7-e55b-4727-abc0-17116af02756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:14:56 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-591d9fbc-3253-4dd5-90d5-dd6eef16aca0 tempest-VolumesGetTest-470092308 None] Created volume successfully. Apr 07 06:14:57 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0" returned: 0 in 0.470s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:57 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1 Apr 07 06:14:57 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] Acquiring lock "cinder-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] Lock "cinder-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] Acquiring lock "cinder-quobyte-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] Lock "cinder-quobyte-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:57 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aff06bc-3e86-40bb-83cb-98726954528e]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:57 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0 Apr 07 06:14:57 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:57 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1" returned: 0 in 0.495s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:57 devstack sudo[89725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1 Apr 07 06:14:57 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:58 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0" returned: 0 in 0.455s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:58 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0 Apr 07 06:14:58 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:58 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0.875bbf39-0292-42cb-a10f-f235330de4b1" returned: 0 in 0.426s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] Lock "cinder-quobyte-875bbf39-0292-42cb-a10f-f235330de4b1" released by "_delete_snapshot" :: held 1.982s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] Lock "cinder-quobyte-03266a3e-5eb2-43d8-9951-93574a83bba0" released by "delete_snapshot" :: held 1.997s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] Created reservations ['e8b7f44f-1405-47bd-a33e-6860f5b82424', 'd4ed5b79-ea6a-4a48-a6ad-6a768b53d116', 'b8ce2ecf-f937-4eaa-bc14-441d045a3e55', '7e4d2aec-42ad-4f1d-bc8a-1172613eeba3'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:58 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] Delete snapshot completed successfully. Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-018289aa-bc92-45fa-9240-b33083565dca tempest-SnapshotDependencyTests-1641990033 None] Lock "cinder-875bbf39-0292-42cb-a10f-f235330de4b1-delete_snapshot" released by "delete_snapshot" :: held 2.093s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:58 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0" returned: 0 in 0.393s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] Lock "cinder-quobyte-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0" released by "delete_volume" :: held 0.872s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] Created reservations ['557de1f0-2172-4bcb-b1b3-19f39731e333', '9d009053-5466-4cd6-a5b2-313e85fd995c', '324cab58-3d51-4226-b2db-4918fe747ea8', 'cff56930-8826-4db0-bd03-ab20e227b195'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:58 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:14:58 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] Acquiring lock "cinder-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] Lock "cinder-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] Acquiring lock "cinder-quobyte-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] Lock "cinder-quobyte-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0" acquired by "delete_volume" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbecc57-85c3-4d69-88b5-5a6cd6db3a51]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:59 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0 Apr 07 06:14:59 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:59 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.421s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:14:59 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] Deleted volume successfully. Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-6aae3bfe-ac38-4cdf-8e57-c613db2c01cd tempest-VolumesGetTest-470092308 None] Lock "cinder-8d0532b1-d8ed-40c4-9c0e-5ecfb59d39f0-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:59 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0" returned: 0 in 0.471s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:59 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0 Apr 07 06:14:59 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] Acquiring lock "cinder-03266a3e-5eb2-43d8-9951-93574a83bba0-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] Lock "cinder-03266a3e-5eb2-43d8-9951-93574a83bba0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] Acquiring lock "cinder-quobyte-03266a3e-5eb2-43d8-9951-93574a83bba0" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] Lock "cinder-quobyte-03266a3e-5eb2-43d8-9951-93574a83bba0" acquired by "delete_volume" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1569ed-95f9-481a-a2dc-cdf0214277ea]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:59 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 Apr 07 06:14:59 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:59 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0" returned: 0 in 0.391s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] Lock "cinder-quobyte-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0" released by "delete_volume" :: held 0.883s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] Created reservations ['73b83e63-4622-4319-acf9-b0981f717cfa', 'be5d7e11-f266-43ff-b82b-12cebd90019c', '3fe3e530-9256-48c5-a4b8-6d5ea969947b', 'da7cfe23-b2b2-4aa9-9637-4d72e299e6d7'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:14:59 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:14:59 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:14:59 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0" returned: 0 in 0.462s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:14:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:00 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0 Apr 07 06:15:00 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] Acquiring lock "cinder-c73d29ca-611b-494b-9891-8f7234d7be38-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] Lock "cinder-c73d29ca-611b-494b-9891-8f7234d7be38-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] Acquiring lock "cinder-quobyte-c73d29ca-611b-494b-9891-8f7234d7be38" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] Lock "cinder-quobyte-c73d29ca-611b-494b-9891-8f7234d7be38" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abcca19-ae09-4b4b-bd33-8ca77afe7a04]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:00 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 Apr 07 06:15:00 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:00 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.431s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:00 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] Deleted volume successfully. Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d3c81c45-1f4e-4ca5-a991-b5f41e67bcfa tempest-VolumesGetTest-470092308 None] Lock "cinder-fcd4d09b-ceb3-4cf5-ae61-9a0f280adfb0-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:00 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-03266a3e-5eb2-43d8-9951-93574a83bba0" returned: 0 in 0.453s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] Lock "cinder-quobyte-03266a3e-5eb2-43d8-9951-93574a83bba0" released by "delete_volume" :: held 0.940s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] Created reservations ['58a767b5-8fac-4aa9-a4bd-a83cf6c05573', '9e0de7e6-c121-4bbb-bcfe-577df6455f31', '844460c3-85af-4b8f-84fe-5927cebd7fe3', '73890dcd-f650-4bf6-ac8b-0ceeb2b991fc'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:00 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:15:00 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:00 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] Acquiring lock "cinder-70d3d5c1-a065-46b9-9e21-982802a25b8a-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38" returned: 0 in 0.479s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] Lock "cinder-70d3d5c1-a065-46b9-9e21-982802a25b8a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:00 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38 Apr 07 06:15:00 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] Acquiring lock "cinder-quobyte-70d3d5c1-a065-46b9-9e21-982802a25b8a" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] Lock "cinder-quobyte-70d3d5c1-a065-46b9-9e21-982802a25b8a" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bce8db5-193a-4441-8fb4-6dd151e816f0]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d3d5c1-a065-46b9-9e21-982802a25b8a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:00 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d3d5c1-a065-46b9-9e21-982802a25b8a Apr 07 06:15:00 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:00 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.451s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:00 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:00 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] Deleted volume successfully. Apr 07 06:15:01 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c73d29ca-611b-494b-9891-8f7234d7be38" returned: 0 in 0.409s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b8477902-5509-4e41-8561-214c9fb3fe83 tempest-SnapshotDependencyTests-1641990033 None] Lock "cinder-03266a3e-5eb2-43d8-9951-93574a83bba0-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] Lock "cinder-quobyte-c73d29ca-611b-494b-9891-8f7234d7be38" released by "delete_volume" :: held 0.919s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] Created reservations ['562ce54b-422b-431b-8bb6-d036515e3d03', '64374353-88e3-4e9f-b372-46db1003d9f1', 'e00fe157-0b6a-4ed5-8fa4-84ce8f8d6515', 'f5a0c198-18f2-4a58-b57d-b470d2800757'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:01 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:15:01 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:01 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d3d5c1-a065-46b9-9e21-982802a25b8a" returned: 0 in 0.523s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d3d5c1-a065-46b9-9e21-982802a25b8a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:01 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d3d5c1-a065-46b9-9e21-982802a25b8a Apr 07 06:15:01 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Flow 'volume_create_manager' (9443ad80-6672-49ab-8cdf-462dc5bc28da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d610273f-dec7-487c-bb8e-53b2340460fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d610273f-dec7-487c-bb8e-53b2340460fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1005201550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=933541ed-6c0f-4742-b819-8c4dfc9aa773,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7c0360931b99417bbe7d139e82a5231c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:02Z,use_quota=True,user_id='71e686e9c6cd468883c310b682aab307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb5b5ec-9081-4c45-a022-1d88b9647b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb5b5ec-9081-4c45-a022-1d88b9647b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:01 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b6d707-ef0c-4162-a889-1c5894e17833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.image.glance [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Creating Keystone auth plugin from conf {{(pid=82475) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.533s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:01 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] Deleted volume successfully. Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-adf35209-e052-4a18-9dd1-af014efa593d tempest-VolumesGetTest-470092308 None] Lock "cinder-c73d29ca-611b-494b-9891-8f7234d7be38-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:01 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-70d3d5c1-a065-46b9-9e21-982802a25b8a" returned: 0 in 0.491s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] Lock "cinder-quobyte-70d3d5c1-a065-46b9-9e21-982802a25b8a" released by "delete_volume" :: held 1.036s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] Created reservations ['df203c16-0d2e-4007-ae41-fbec700ae95a', '51f24646-f6d6-4d14-bf19-529f3500facb', '4300f46f-a218-4033-834c-d3f24cb07376', 'd3fadd2c-3657-4488-8f35-030f78cb5de8'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:01 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:15:01 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b6d707-ef0c-4162-a889-1c5894e17833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '933541ed-6c0f-4742-b819-8c4dfc9aa773', 'volume_name': 'volume-933541ed-6c0f-4742-b819-8c4dfc9aa773', 'volume_size': 1, 'image_id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b1699f15f0f4ed99342800159112237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e597d39-f7d0-437d-988f-e2351ab702ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a9d00d-a17c-428d-b8da-3c36e0c881fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a9d00d-a17c-428d-b8da-3c36e0c881fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb4cc8b-091a-4eae-808d-6567e3b776d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:01 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Volume 933541ed-6c0f-4742-b819-8c4dfc9aa773: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-933541ed-6c0f-4742-b819-8c4dfc9aa773', 'volume_size': 1, 'image_id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b1699f15f0f4ed99342800159112237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e597d39-f7d0-437d-988f-e2351ab702ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 07 06:15:01 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Trying to clone 933541ed-6c0f-4742-b819-8c4dfc9aa773 from image 2e597d39-f7d0-437d-988f-e2351ab702ec at location (None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}]). {{(pid=82475) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 07 06:15:02 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f8awktpbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82475) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 07 06:15:02 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Image download 20.69 MB at 20.69 MB/s Apr 07 06:15:02 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22c9600-ae14-4a74-b8c9-9953d60ecfd0]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f8awktpbdevstack@QuobyteHD {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:02 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f8awktpbdevstack@QuobyteHD Apr 07 06:15:02 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:02 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.430s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:02 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:02 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] Deleted volume successfully. Apr 07 06:15:02 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-06fd3971-d358-4787-a1fa-c4ff76601841 tempest-SnapshotDependencyTests-1641990033 None] Lock "cinder-70d3d5c1-a065-46b9-9e21-982802a25b8a-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:02 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f8awktpbdevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:02 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Temporary image 2e597d39-f7d0-437d-988f-e2351ab702ec is fetched for user 71e686e9c6cd468883c310b682aab307. {{(pid=82475) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 07 06:15:02 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[03631142-0f3b-42e5-afc7-8e2d2988460f]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f8awktpbdevstack@QuobyteHD {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:02 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f8awktpbdevstack@QuobyteHD Apr 07 06:15:02 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:03 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f8awktpbdevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1005201550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=933541ed-6c0f-4742-b819-8c4dfc9aa773,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7c0360931b99417bbe7d139e82a5231c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:02Z,use_quota=True,user_id='71e686e9c6cd468883c310b682aab307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Creating volume 933541ed-6c0f-4742-b819-8c4dfc9aa773 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:03 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:03 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:03 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 1073741824 Apr 07 06:15:03 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:03 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 1073741824" returned: 0 in 0.514s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:03 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 Apr 07 06:15:03 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:04 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773" returned: 0 in 0.463s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:04 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:04 devstack cinder-volume[82475]: DEBUG cinder.volume.volume_utils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Attempting download of 2e597d39-f7d0-437d-988f-e2351ab702ec ((None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}])) to volume 933541ed-6c0f-4742-b819-8c4dfc9aa773. {{(pid=82475) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 07 06:15:04 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[743ef6a0-0e83-46ac-874d-5f83fb3e820c]: (4, 'raw') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_rvwez4eo {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:04 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_rvwez4eo Apr 07 06:15:04 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:04 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_rvwez4eo" returned: 0 in 0.487s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_rvwez4eo {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:04 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_rvwez4eo Apr 07 06:15:04 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:05 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_rvwez4eo" returned: 1 in 0.501s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e597d39-f7d0-437d-988f-e2351ab702ec_rvwez4eo' failed. Not Retrying. {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:15:05 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c82b36e-f886-414a-aa8d-574d94b93149]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f8awktpbdevstack@QuobyteHD {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:05 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f8awktpbdevstack@QuobyteHD Apr 07 06:15:05 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:05 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f8awktpbdevstack@QuobyteHD" returned: 0 in 0.496s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:05 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] 2e597d39-f7d0-437d-988f-e2351ab702ec was qcow2, converting to raw {{(pid=82475) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 07 06:15:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f8awktpbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:05 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f8awktpbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 Apr 07 06:15:05 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:06 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f8awktpbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773" returned: 0 in 0.900s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:06 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2e597d39-f7d0-437d-988f-e2351ab702ec_f8awktpbdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:15:06 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Converted 112.00 MB image at 112.00 MB/s Apr 07 06:15:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:06 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 1G Apr 07 06:15:06 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:07 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 1G" returned: 0 in 0.471s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:07 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[975752c4-fb7f-4103-be39-0ecc3c72ed05]: (4, 'raw') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:07 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 Apr 07 06:15:07 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:07 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773" returned: 0 in 0.550s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:07 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 Apr 07 06:15:07 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:08 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773" returned: 1 in 0.542s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773' failed. Not Retrying. {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:15:08 devstack cinder-volume[82475]: DEBUG cinder.volume.volume_utils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Downloaded image 2e597d39-f7d0-437d-988f-e2351ab702ec ((None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}])) to volume 933541ed-6c0f-4742-b819-8c4dfc9aa773 successfully. {{(pid=82475) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 07 06:15:08 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Temporary image 2e597d39-f7d0-437d-988f-e2351ab702ec for user 71e686e9c6cd468883c310b682aab307 is deleted. {{(pid=82475) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 07 06:15:08 devstack cinder-volume[82475]: DEBUG cinder.volume.volume_utils [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Marking volume 933541ed-6c0f-4742-b819-8c4dfc9aa773 as bootable. {{(pid=82475) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 07 06:15:08 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Copying metadata from image 2e597d39-f7d0-437d-988f-e2351ab702ec to 933541ed-6c0f-4742-b819-8c4dfc9aa773. {{(pid=82475) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 07 06:15:08 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Creating volume glance metadata for volume 933541ed-6c0f-4742-b819-8c4dfc9aa773 backed by image 2e597d39-f7d0-437d-988f-e2351ab702ec with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82475) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 07 06:15:08 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb4cc8b-091a-4eae-808d-6567e3b776d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-933541ed-6c0f-4742-b819-8c4dfc9aa773', 'volume_size': 1, 'image_id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e597d39-f7d0-437d-988f-e2351ab702ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b1699f15f0f4ed99342800159112237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2e597d39-f7d0-437d-988f-e2351ab702ec', 'created_at': datetime.datetime(2026, 4, 7, 4, 0, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 7, 4, 0, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e597d39-f7d0-437d-988f-e2351ab702ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:08 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e1b171-a3e3-4d0d-a7da-989f2decda4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:08 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Volume volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 (933541ed-6c0f-4742-b819-8c4dfc9aa773): created successfully Apr 07 06:15:08 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e1b171-a3e3-4d0d-a7da-989f2decda4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:08 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Flow 'volume_create_manager' (9443ad80-6672-49ab-8cdf-462dc5bc28da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:08 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-3f264045-91cc-4739-9403-c257070b31cf tempest-VolumesGetTest-470092308 None] Created volume successfully. Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Flow 'volume_create_manager' (3e9b5b38-7292-440c-a639-d01eb8b76342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e22762a-208e-4376-a4a3-8074cc28cf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e22762a-208e-4376-a4a3-8074cc28cf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-771374433',display_name='tempest-VolumesGetTest-Volume-1548523376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cfbd1d7-a938-4dd0-a824-3f08a8f19a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0360931b99417bbe7d139e82a5231c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:09Z,use_quota=True,user_id='71e686e9c6cd468883c310b682aab307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7dec29a-2221-4660-a17f-3fa4700dea2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7dec29a-2221-4660-a17f-3fa4700dea2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4b093f-ba84-4f32-96f4-94239448caf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4b093f-ba84-4f32-96f4-94239448caf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cfbd1d7-a938-4dd0-a824-3f08a8f19a98', 'volume_name': 'volume-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d680c3-5bdd-4a91-a767-4317661a99e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d680c3-5bdd-4a91-a767-4317661a99e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b9ba490-5557-4b03-b429-b86360e10120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:09 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Volume 0cfbd1d7-a938-4dd0-a824-3f08a8f19a98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98', 'volume_size': 1} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-771374433',display_name='tempest-VolumesGetTest-Volume-1548523376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cfbd1d7-a938-4dd0-a824-3f08a8f19a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0360931b99417bbe7d139e82a5231c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:09Z,use_quota=True,user_id='71e686e9c6cd468883c310b682aab307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Creating volume 0cfbd1d7-a938-4dd0-a824-3f08a8f19a98 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:09 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:09 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98 1073741824 Apr 07 06:15:09 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:10 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98 1073741824" returned: 0 in 0.476s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:10 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98 Apr 07 06:15:10 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:10 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98" returned: 0 in 0.367s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b9ba490-5557-4b03-b429-b86360e10120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43ff402-b2e0-421c-83c8-5a6cd839e2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:10 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Volume volume-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98 (0cfbd1d7-a938-4dd0-a824-3f08a8f19a98): created successfully Apr 07 06:15:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43ff402-b2e0-421c-83c8-5a6cd839e2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Flow 'volume_create_manager' (3e9b5b38-7292-440c-a639-d01eb8b76342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:10 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-c3f2a7c4-69ca-4f7e-947a-1a5571d67455 tempest-VolumesGetTest-470092308 None] Created volume successfully. Apr 07 06:15:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] Acquiring lock "cinder-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] Lock "cinder-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] Acquiring lock "cinder-quobyte-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] Lock "cinder-quobyte-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:11 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[391a31e3-3c2c-4564-bdb3-8e45d2dd8bc6]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:11 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98 Apr 07 06:15:11 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:12 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98" returned: 0 in 0.426s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:12 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98 Apr 07 06:15:12 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:12 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98" returned: 0 in 0.362s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] Lock "cinder-quobyte-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98" released by "delete_volume" :: held 0.814s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:12 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] Created reservations ['78473305-51c0-4c33-a930-b4c1e3adf4b7', '2c03e17f-c900-44d2-bbd2-29cb4329ffff', '113204b2-7a36-4f3f-bd31-960a8ab76065', '61986291-8884-4c08-b484-3c2f1848e9b4'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:12 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:12 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:12 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:15:12 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] Acquiring lock "cinder-933541ed-6c0f-4742-b819-8c4dfc9aa773-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] Lock "cinder-933541ed-6c0f-4742-b819-8c4dfc9aa773-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] Acquiring lock "cinder-quobyte-933541ed-6c0f-4742-b819-8c4dfc9aa773" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] Lock "cinder-quobyte-933541ed-6c0f-4742-b819-8c4dfc9aa773" acquired by "delete_volume" :: waited 0.017s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:12 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c98ce1-dfa9-411a-b1c8-e49633c4b4cb]: (4, 'raw') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:12 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 Apr 07 06:15:12 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:13 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.450s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:13 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:13 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] Deleted volume successfully. Apr 07 06:15:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-33f740b4-3985-4f72-b991-7d28db7df5b3 tempest-VolumesGetTest-470092308 None] Lock "cinder-0cfbd1d7-a938-4dd0-a824-3f08a8f19a98-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:13 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773" returned: 0 in 0.465s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:13 devstack sudo[89879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 Apr 07 06:15:13 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:13 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773" returned: 1 in 0.500s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773' failed. Not Retrying. {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 07 06:15:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:13 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773 Apr 07 06:15:13 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:14 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-933541ed-6c0f-4742-b819-8c4dfc9aa773" returned: 0 in 0.427s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] Lock "cinder-quobyte-933541ed-6c0f-4742-b819-8c4dfc9aa773" released by "delete_volume" :: held 1.430s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:14 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:SELECT=121,cinder:INSERT=46,cinder:UPDATE=139,cinder:DELETE=12 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:15:14 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:SELECT=124,cinder:UPDATE=171,cinder:INSERT=41,cinder:DELETE=13 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:15:14 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] Created reservations ['e1d7898d-52ba-4fe2-b7f7-9fd4a3e59065', '566dfc54-a83c-406c-b65a-fd558e6b1ffa', '74985ede-2dca-4b44-9f7f-ef83bf825e0d', 'ff2063ce-a547-4926-9d96-d6aab4313520'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:14 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:14 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:14 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:15:14 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:14 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.389s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:14 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:14 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] Deleted volume successfully. Apr 07 06:15:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-88bd4d69-b4d1-46a1-ab51-0bd56e6dd9da tempest-VolumesGetTest-470092308 None] Lock "cinder-933541ed-6c0f-4742-b819-8c4dfc9aa773-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:21 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Flow 'volume_create_manager' (e8d5c4a9-0223-4d98-9925-dd955bdb7fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4993dbfe-d262-4df2-beac-632f93b0195a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4993dbfe-d262-4df2-beac-632f93b0195a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1116428081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee410d8f-2ab8-43a7-9de1-cfc7e22925b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87867cb9c9c24c62973ae02fbcfb9d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:22Z,use_quota=True,user_id='83113b23b7a842b688a9b71ab7b9f2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e917f106-7dad-4ba2-b076-504ca2e349bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e917f106-7dad-4ba2-b076-504ca2e349bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c73afd-2622-4e4c-bd8d-c81c56e4fecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c73afd-2622-4e4c-bd8d-c81c56e4fecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee410d8f-2ab8-43a7-9de1-cfc7e22925b3', 'volume_name': 'volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a417cd59-7ff9-4248-8e0c-4c49490a4654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a417cd59-7ff9-4248-8e0c-4c49490a4654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db9633e5-5add-4d33-a048-37c4ac150d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Volume ee410d8f-2ab8-43a7-9de1-cfc7e22925b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3', 'volume_size': 1} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1116428081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee410d8f-2ab8-43a7-9de1-cfc7e22925b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87867cb9c9c24c62973ae02fbcfb9d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:22Z,use_quota=True,user_id='83113b23b7a842b688a9b71ab7b9f2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Creating volume ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:22 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:22 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 1073741824 Apr 07 06:15:22 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Flow 'volume_create_manager' (ea06f534-e6ed-4976-8d39-778a26aab890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53dd12c-07a5-4252-a2a5-462f201881eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53dd12c-07a5-4252-a2a5-462f201881eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-23453195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233eae86-59a0-4779-b6c2-89d0c21635ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2487db81a8444ba38e8bdc7057fdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:22Z,use_quota=True,user_id='6ee463f2880d4a2393c53f35d87d09b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd57297-039e-47cc-8a50-4236e32f864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd57297-039e-47cc-8a50-4236e32f864c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7818e0b9-12e1-4b1a-80be-9ae6634b5c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7818e0b9-12e1-4b1a-80be-9ae6634b5c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '233eae86-59a0-4779-b6c2-89d0c21635ee', 'volume_name': 'volume-233eae86-59a0-4779-b6c2-89d0c21635ee', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4acb1633-59f2-40a1-87bb-2709380cc529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4acb1633-59f2-40a1-87bb-2709380cc529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5a5b51-ba07-46b7-be28-a4f460bc9cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Volume 233eae86-59a0-4779-b6c2-89d0c21635ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-233eae86-59a0-4779-b6c2-89d0c21635ee', 'volume_size': 1} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Flow 'volume_create_manager' (7f228645-8663-4794-a451-bd3666044c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (973187a2-545a-465b-b02d-f06072e6d5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (973187a2-545a-465b-b02d-f06072e6d5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1856820278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf82820-f9f4-4d7f-ab96-c3dc65283847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbe776cc2d54f8d8f6f185a6f92d994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:22Z,use_quota=True,user_id='02c4663862e2446c95b4387b54050744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f15d81a4-a3bc-4a04-a804-ad0a6255d9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f15d81a4-a3bc-4a04-a804-ad0a6255d9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64efdc1-e735-4632-8803-f93bf4234dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64efdc1-e735-4632-8803-f93bf4234dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bf82820-f9f4-4d7f-ab96-c3dc65283847', 'volume_name': 'volume-6bf82820-f9f4-4d7f-ab96-c3dc65283847', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c60813d-9bbd-4720-95f0-76dc47426dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c60813d-9bbd-4720-95f0-76dc47426dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973599a7-3f05-41f6-b6e6-69b6a787d47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Volume 6bf82820-f9f4-4d7f-ab96-c3dc65283847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bf82820-f9f4-4d7f-ab96-c3dc65283847', 'volume_size': 1} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Flow 'volume_create_manager' (f0603322-ff4a-468b-9a3f-342bd99caec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffd81e8-d3fe-46b9-bd96-94ffe6d8c740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffd81e8-d3fe-46b9-bd96-94ffe6d8c740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-746727084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbe776cc2d54f8d8f6f185a6f92d994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:22Z,use_quota=True,user_id='02c4663862e2446c95b4387b54050744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e196e32-b272-43c8-8d5f-f8e68bfad15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e196e32-b272-43c8-8d5f-f8e68bfad15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c0ec14-9227-4b85-b038-87b0b0bcae8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c0ec14-9227-4b85-b038-87b0b0bcae8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b', 'volume_name': 'volume-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07dede70-34cc-448a-9b4a-c0142fd6a789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07dede70-34cc-448a-9b4a-c0142fd6a789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f5bbd9-603d-49fd-9afa-131a16b74568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Volume dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b', 'volume_size': 1} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:22 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 1073741824" returned: 0 in 0.650s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Flow 'volume_create_manager' (cb2b517e-7968-4104-b8cc-5e309557ea50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51abeea1-0dc8-4f5e-acf3-3b4a80351fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51abeea1-0dc8-4f5e-acf3-3b4a80351fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-556663572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294f42c8-b08d-4fec-b8c7-d837ecaa578e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbe776cc2d54f8d8f6f185a6f92d994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:23Z,use_quota=True,user_id='02c4663862e2446c95b4387b54050744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ff7e10-ee53-43a4-8434-c2ef33a03f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ff7e10-ee53-43a4-8434-c2ef33a03f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0692339-cddf-49f2-bad3-b04efeb98271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0692339-cddf-49f2-bad3-b04efeb98271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '294f42c8-b08d-4fec-b8c7-d837ecaa578e', 'volume_name': 'volume-294f42c8-b08d-4fec-b8c7-d837ecaa578e', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf73878-aa69-4502-9473-aed3a0c7b78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf73878-aa69-4502-9473-aed3a0c7b78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c80e557-62d0-4a9d-b4e7-aa32cfb43c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:22 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Volume 294f42c8-b08d-4fec-b8c7-d837ecaa578e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-294f42c8-b08d-4fec-b8c7-d837ecaa578e', 'volume_size': 1} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:22 devstack sudo[89969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 Apr 07 06:15:22 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Flow 'volume_create_manager' (93c5d48a-d69c-47a2-b8a7-9f39c9934e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e40059a9-73b4-489b-9e86-af146d4d633a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e40059a9-73b4-489b-9e86-af146d4d633a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1818834025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c99e22b-eda8-45b6-9d63-269ff0c8b30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbe776cc2d54f8d8f6f185a6f92d994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:23Z,use_quota=True,user_id='02c4663862e2446c95b4387b54050744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1fcfac8-03e8-4f2e-9b0f-df322b497182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1fcfac8-03e8-4f2e-9b0f-df322b497182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7bd6ad-bbea-453a-b1d0-04fdf3883632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7bd6ad-bbea-453a-b1d0-04fdf3883632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c99e22b-eda8-45b6-9d63-269ff0c8b30c', 'volume_name': 'volume-2c99e22b-eda8-45b6-9d63-269ff0c8b30c', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a350f9-0f24-4b52-a8d2-73e17847192c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a350f9-0f24-4b52-a8d2-73e17847192c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ea5eab-1ec8-4615-ad4a-9b35f25de66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:23 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Volume 2c99e22b-eda8-45b6-9d63-269ff0c8b30c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c99e22b-eda8-45b6-9d63-269ff0c8b30c', 'volume_size': 1} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Flow 'volume_create_manager' (2ab8342c-4ffa-48f3-9cd0-e709bc841954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3555a13-d63e-4687-9f89-e312c1ef4371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3555a13-d63e-4687-9f89-e312c1ef4371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1375929937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2fac7ae-f0c5-4678-ac3a-7c1dd0491552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbe776cc2d54f8d8f6f185a6f92d994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:23Z,use_quota=True,user_id='02c4663862e2446c95b4387b54050744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b20a88-bd68-4776-8a53-6661872a67af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b20a88-bd68-4776-8a53-6661872a67af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fda8c78-f4c2-4ab0-8dc6-e7dacb2e6f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fda8c78-f4c2-4ab0-8dc6-e7dacb2e6f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2fac7ae-f0c5-4678-ac3a-7c1dd0491552', 'volume_name': 'volume-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e87e4e7-a424-4c3b-a7bf-054e1de95c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e87e4e7-a424-4c3b-a7bf-054e1de95c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3de30a0-8eba-4bbd-a091-b3979e4a9ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:23 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Volume d2fac7ae-f0c5-4678-ac3a-7c1dd0491552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552', 'volume_size': 1} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:23 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3" returned: 0 in 0.551s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.156s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-23453195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233eae86-59a0-4779-b6c2-89d0c21635ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2487db81a8444ba38e8bdc7057fdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:22Z,use_quota=True,user_id='6ee463f2880d4a2393c53f35d87d09b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Creating volume 233eae86-59a0-4779-b6c2-89d0c21635ee {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:23 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db9633e5-5add-4d33-a048-37c4ac150d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:23 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee 1073741824 Apr 07 06:15:23 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c1a158-b3cb-423f-883f-48bd25317c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:23 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Volume volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 (ee410d8f-2ab8-43a7-9de1-cfc7e22925b3): created successfully Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c1a158-b3cb-423f-883f-48bd25317c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:23 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Flow 'volume_create_manager' (e8d5c4a9-0223-4d98-9925-dd955bdb7fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:23 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-c46b9668-b60e-4db9-9df7-0165ea66144d tempest-VolumeDependencyTests-794886482 None] Created volume successfully. Apr 07 06:15:24 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee 1073741824" returned: 0 in 0.569s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:24 devstack sudo[89977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee Apr 07 06:15:24 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-09ff314a-b37c-4b01-a0c1-0536026202d8 tempest-VolumeDependencyTests-794886482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:24 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee" returned: 0 in 0.477s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.141s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1856820278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf82820-f9f4-4d7f-ab96-c3dc65283847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbe776cc2d54f8d8f6f185a6f92d994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:22Z,use_quota=True,user_id='02c4663862e2446c95b4387b54050744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Creating volume 6bf82820-f9f4-4d7f-ab96-c3dc65283847 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:24 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6bf82820-f9f4-4d7f-ab96-c3dc65283847 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5a5b51-ba07-46b7-be28-a4f460bc9cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-233eae86-59a0-4779-b6c2-89d0c21635ee', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19cf8ca-3a71-4bee-9a09-8a73100816ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:24 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6bf82820-f9f4-4d7f-ab96-c3dc65283847 1073741824 Apr 07 06:15:24 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:24 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Volume volume-233eae86-59a0-4779-b6c2-89d0c21635ee (233eae86-59a0-4779-b6c2-89d0c21635ee): created successfully Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19cf8ca-3a71-4bee-9a09-8a73100816ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:24 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Flow 'volume_create_manager' (ea06f534-e6ed-4976-8d39-778a26aab890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:24 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-020493dd-b7cf-4aae-933e-3ec1e6a2c6a3 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Created volume successfully. Apr 07 06:15:25 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6bf82820-f9f4-4d7f-ab96-c3dc65283847 1073741824" returned: 0 in 0.532s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6bf82820-f9f4-4d7f-ab96-c3dc65283847 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:25 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6bf82820-f9f4-4d7f-ab96-c3dc65283847 Apr 07 06:15:25 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ccd73fdb-1ffc-4c48-bca7-124bd848dbdf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:25 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6bf82820-f9f4-4d7f-ab96-c3dc65283847" returned: 0 in 0.508s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.979s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-746727084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbe776cc2d54f8d8f6f185a6f92d994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:22Z,use_quota=True,user_id='02c4663862e2446c95b4387b54050744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Creating volume dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:25 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973599a7-3f05-41f6-b6e6-69b6a787d47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bf82820-f9f4-4d7f-ab96-c3dc65283847', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e941e7-5ff6-4e3c-b995-f3a4ef453417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:25 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b 1073741824 Apr 07 06:15:25 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:25 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Volume volume-6bf82820-f9f4-4d7f-ab96-c3dc65283847 (6bf82820-f9f4-4d7f-ab96-c3dc65283847): created successfully Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e941e7-5ff6-4e3c-b995-f3a4ef453417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:25 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Flow 'volume_create_manager' (7f228645-8663-4794-a451-bd3666044c9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:25 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-b9061fb4-e978-4afe-8bd8-dff9abfa255a tempest-CreateVolumesFromImageTest-1527787716 None] Created volume successfully. Apr 07 06:15:26 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b 1073741824" returned: 0 in 0.537s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:26 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b Apr 07 06:15:26 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:26 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b" returned: 0 in 0.505s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.814s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-556663572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294f42c8-b08d-4fec-b8c7-d837ecaa578e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbe776cc2d54f8d8f6f185a6f92d994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:23Z,use_quota=True,user_id='02c4663862e2446c95b4387b54050744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Creating volume 294f42c8-b08d-4fec-b8c7-d837ecaa578e {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:26 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:26 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:26 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-294f42c8-b08d-4fec-b8c7-d837ecaa578e 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f5bbd9-603d-49fd-9afa-131a16b74568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11962f7c-3317-4cef-900b-bdfe74104441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:26 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-294f42c8-b08d-4fec-b8c7-d837ecaa578e 1073741824 Apr 07 06:15:26 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:26 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Volume volume-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b (dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b): created successfully Apr 07 06:15:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11962f7c-3317-4cef-900b-bdfe74104441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:26 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Flow 'volume_create_manager' (f0603322-ff4a-468b-9a3f-342bd99caec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:26 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-bbe71fd6-ee85-4174-951d-6c26c51631ef tempest-CreateVolumesFromImageTest-1527787716 None] Created volume successfully. Apr 07 06:15:27 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-294f42c8-b08d-4fec-b8c7-d837ecaa578e 1073741824" returned: 0 in 0.599s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-294f42c8-b08d-4fec-b8c7-d837ecaa578e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:27 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-294f42c8-b08d-4fec-b8c7-d837ecaa578e Apr 07 06:15:27 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:27 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-294f42c8-b08d-4fec-b8c7-d837ecaa578e" returned: 0 in 0.446s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:27 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.589s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:27 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1818834025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c99e22b-eda8-45b6-9d63-269ff0c8b30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbe776cc2d54f8d8f6f185a6f92d994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:23Z,use_quota=True,user_id='02c4663862e2446c95b4387b54050744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:27 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Creating volume 2c99e22b-eda8-45b6-9d63-269ff0c8b30c {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:27 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:27 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:27 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:27 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:27 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2c99e22b-eda8-45b6-9d63-269ff0c8b30c 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:27 devstack sudo[90004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2c99e22b-eda8-45b6-9d63-269ff0c8b30c 1073741824 Apr 07 06:15:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c80e557-62d0-4a9d-b4e7-aa32cfb43c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-294f42c8-b08d-4fec-b8c7-d837ecaa578e', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:27 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e1448a-2d19-42df-9596-5cd90e1b2681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:27 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Volume volume-294f42c8-b08d-4fec-b8c7-d837ecaa578e (294f42c8-b08d-4fec-b8c7-d837ecaa578e): created successfully Apr 07 06:15:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e1448a-2d19-42df-9596-5cd90e1b2681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:27 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Flow 'volume_create_manager' (cb2b517e-7968-4104-b8cc-5e309557ea50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:27 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-ff3949a5-ac36-404c-b829-06b5df6d3219 tempest-CreateVolumesFromImageTest-1527787716 None] Created volume successfully. Apr 07 06:15:28 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2c99e22b-eda8-45b6-9d63-269ff0c8b30c 1073741824" returned: 0 in 0.466s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2c99e22b-eda8-45b6-9d63-269ff0c8b30c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:28 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2c99e22b-eda8-45b6-9d63-269ff0c8b30c Apr 07 06:15:28 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:28 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2c99e22b-eda8-45b6-9d63-269ff0c8b30c" returned: 0 in 0.444s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:28 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.289s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:28 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1375929937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2fac7ae-f0c5-4678-ac3a-7c1dd0491552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbe776cc2d54f8d8f6f185a6f92d994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:23Z,use_quota=True,user_id='02c4663862e2446c95b4387b54050744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:28 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Creating volume d2fac7ae-f0c5-4678-ac3a-7c1dd0491552 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:28 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:28 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:28 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:28 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:28 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:28 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552 1073741824 Apr 07 06:15:28 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:28 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ea5eab-1ec8-4615-ad4a-9b35f25de66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c99e22b-eda8-45b6-9d63-269ff0c8b30c', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:28 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468f301d-f192-46a0-8f7f-c685a7d0e55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:28 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Volume volume-2c99e22b-eda8-45b6-9d63-269ff0c8b30c (2c99e22b-eda8-45b6-9d63-269ff0c8b30c): created successfully Apr 07 06:15:28 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468f301d-f192-46a0-8f7f-c685a7d0e55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:28 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Flow 'volume_create_manager' (93c5d48a-d69c-47a2-b8a7-9f39c9934e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:28 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-8d5c339c-6556-4a33-a704-9933915c9075 tempest-CreateVolumesFromImageTest-1527787716 None] Created volume successfully. Apr 07 06:15:29 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552 1073741824" returned: 0 in 0.561s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:29 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552 Apr 07 06:15:29 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:29 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552" returned: 0 in 0.423s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:29 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-09ff314a-b37c-4b01-a0c1-0536026202d8 tempest-VolumeDependencyTests-794886482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.381s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:29 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3de30a0-8eba-4bbd-a091-b3979e4a9ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:29 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03005ec9-6d1b-453e-ac54-bcddf70594aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:29 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-09ff314a-b37c-4b01-a0c1-0536026202d8 tempest-VolumeDependencyTests-794886482 None] Creating offline snapshot 8b74092b-aefd-441f-b69d-b512bb995987 of volume ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:15:29 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Volume volume-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552 (d2fac7ae-f0c5-4678-ac3a-7c1dd0491552): created successfully Apr 07 06:15:29 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03005ec9-6d1b-453e-ac54-bcddf70594aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:29 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Flow 'volume_create_manager' (2ab8342c-4ffa-48f3-9cd0-e709bc841954) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:29 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf49767-bd35-4d82-9d45-a90b5290b22a]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:29 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09ff314a-b37c-4b01-a0c1-0536026202d8 tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:29 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-244cdbcd-2e1d-4880-9d19-05a91342ca33 tempest-CreateVolumesFromImageTest-1527787716 None] Created volume successfully. Apr 07 06:15:29 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 Apr 07 06:15:29 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:29 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "cinder-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:29 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:30 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "cinder-quobyte-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:30 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-quobyte-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552" acquired by "delete_volume" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:30 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfb7d25-a62d-4aa9-8960-38d755388ac2]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:30 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552 Apr 07 06:15:30 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:30 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09ff314a-b37c-4b01-a0c1-0536026202d8 tempest-VolumeDependencyTests-794886482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3" returned: 0 in 0.600s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09ff314a-b37c-4b01-a0c1-0536026202d8 tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:30 devstack sudo[90029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987 1G Apr 07 06:15:30 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:30 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552" returned: 0 in 0.522s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:30 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:30 devstack sudo[90034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552 Apr 07 06:15:30 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:31 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552" returned: 0 in 0.455s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-quobyte-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552" released by "delete_volume" :: held 0.999s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:31 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09ff314a-b37c-4b01-a0c1-0536026202d8 tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987 1G" returned: 0 in 0.639s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09ff314a-b37c-4b01-a0c1-0536026202d8 tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:31 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] Created reservations ['a3975589-df51-4607-b4e1-0e381b514f05', '56964385-6efd-4ee1-8065-105e0ba9d776', '9ee0587a-444a-4406-89d2-ac07b45301ce', 'd1b219a4-1efb-4087-8115-f2d6f640ecb1'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:31 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987 Apr 07 06:15:31 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:31 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:31 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:15:31 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:31 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09ff314a-b37c-4b01-a0c1-0536026202d8 tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987" returned: 0 in 0.510s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:31 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-09ff314a-b37c-4b01-a0c1-0536026202d8 tempest-VolumeDependencyTests-794886482 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987 is being set with open permissions: ugo+rw Apr 07 06:15:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09ff314a-b37c-4b01-a0c1-0536026202d8 tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:31 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.438s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:31 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:31 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] Deleted volume successfully. Apr 07 06:15:31 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-91b1004c-8990-4b26-a97c-4db1ea9cb1e6 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-d2fac7ae-f0c5-4678-ac3a-7c1dd0491552-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:31 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987 Apr 07 06:15:31 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:31 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09ff314a-b37c-4b01-a0c1-0536026202d8 tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987" returned: 0 in 0.431s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:31 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09ff314a-b37c-4b01-a0c1-0536026202d8 tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:32 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.info Apr 07 06:15:32 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:32 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "cinder-2c99e22b-eda8-45b6-9d63-269ff0c8b30c-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:32 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-2c99e22b-eda8-45b6-9d63-269ff0c8b30c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:32 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "cinder-quobyte-2c99e22b-eda8-45b6-9d63-269ff0c8b30c" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:32 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-quobyte-2c99e22b-eda8-45b6-9d63-269ff0c8b30c" acquired by "delete_volume" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:32 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[35865d64-af90-4bcf-a0fc-6190469e3c5b]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2c99e22b-eda8-45b6-9d63-269ff0c8b30c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:32 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2c99e22b-eda8-45b6-9d63-269ff0c8b30c Apr 07 06:15:32 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:32 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09ff314a-b37c-4b01-a0c1-0536026202d8 tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.info" returned: 0 in 0.553s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:32 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-09ff314a-b37c-4b01-a0c1-0536026202d8 tempest-VolumeDependencyTests-794886482 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.info is being set with open permissions: ugo+rw Apr 07 06:15:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09ff314a-b37c-4b01-a0c1-0536026202d8 tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:32 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.info Apr 07 06:15:32 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:32 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2c99e22b-eda8-45b6-9d63-269ff0c8b30c" returned: 0 in 0.513s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2c99e22b-eda8-45b6-9d63-269ff0c8b30c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:32 devstack sudo[90061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2c99e22b-eda8-45b6-9d63-269ff0c8b30c Apr 07 06:15:32 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:32 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-09ff314a-b37c-4b01-a0c1-0536026202d8 tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.info" returned: 0 in 0.408s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-09ff314a-b37c-4b01-a0c1-0536026202d8 tempest-VolumeDependencyTests-794886482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.219s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:32 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ccd73fdb-1ffc-4c48-bca7-124bd848dbdf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.512s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:33 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-ccd73fdb-1ffc-4c48-bca7-124bd848dbdf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Creating offline snapshot c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a of volume 233eae86-59a0-4779-b6c2-89d0c21635ee {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:15:33 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97eceb9-a720-4f16-85c3-a0c897498e7d]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ccd73fdb-1ffc-4c48-bca7-124bd848dbdf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:33 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-09ff314a-b37c-4b01-a0c1-0536026202d8 tempest-VolumeDependencyTests-794886482 None] Create snapshot completed successfully Apr 07 06:15:33 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee Apr 07 06:15:33 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:33 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-2c99e22b-eda8-45b6-9d63-269ff0c8b30c" returned: 0 in 0.549s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:33 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-quobyte-2c99e22b-eda8-45b6-9d63-269ff0c8b30c" released by "delete_volume" :: held 1.104s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:33 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] Created reservations ['9f781550-8181-45df-b3b8-9651f198683a', 'a398b9fd-7d34-47d7-afe8-1b18654a8da8', 'd0c8a21b-eb25-495e-a567-13022fbde873', '392482df-2e75-409b-8466-582cf410ca51'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:33 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:33 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:33 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:15:33 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:33 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ccd73fdb-1ffc-4c48-bca7-124bd848dbdf tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee" returned: 0 in 0.556s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:33 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ccd73fdb-1ffc-4c48-bca7-124bd848dbdf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:33 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a 1G Apr 07 06:15:33 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Flow 'volume_create_manager' (7d89e6fb-7e91-4fd6-981b-eac77b5ebf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d6cec5-7c33-41b3-9c09-59ef21e32502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d6cec5-7c33-41b3-9c09-59ef21e32502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-482337715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04599da-7d09-49f3-b068-483aac83ae0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87867cb9c9c24c62973ae02fbcfb9d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8b74092b-aefd-441f-b69d-b512bb995987,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:34Z,use_quota=True,user_id='83113b23b7a842b688a9b71ab7b9f2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c227b077-520c-4c19-8fba-9912b59da9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:34 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c227b077-520c-4c19-8fba-9912b59da9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (debbba1e-a1d7-4646-a7d5-3056e3e122b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (debbba1e-a1d7-4646-a7d5-3056e3e122b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a04599da-7d09-49f3-b068-483aac83ae0f', 'volume_name': 'volume-a04599da-7d09-49f3-b068-483aac83ae0f', 'volume_size': 1, 'snapshot_id': '8b74092b-aefd-441f-b69d-b512bb995987'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6395f78e-fb3f-48b5-8276-fc3894296940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6395f78e-fb3f-48b5-8276-fc3894296940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e355a29-650e-4564-8802-a49b65c016d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:34 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Volume a04599da-7d09-49f3-b068-483aac83ae0f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a04599da-7d09-49f3-b068-483aac83ae0f', 'volume_size': 1, 'snapshot_id': '8b74092b-aefd-441f-b69d-b512bb995987'} Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.688s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:34 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] Deleted volume successfully. Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-dadbfc73-b246-4fcc-8911-1bf13a0be326 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-2c99e22b-eda8-45b6-9d63-269ff0c8b30c-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:34 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ccd73fdb-1ffc-4c48-bca7-124bd848dbdf tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a 1G" returned: 0 in 0.652s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ccd73fdb-1ffc-4c48-bca7-124bd848dbdf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-233eae86-59a0-4779-b6c2-89d0c21635ee -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:34 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-233eae86-59a0-4779-b6c2-89d0c21635ee -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a Apr 07 06:15:34 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "cinder-294f42c8-b08d-4fec-b8c7-d837ecaa578e-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-294f42c8-b08d-4fec-b8c7-d837ecaa578e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "cinder-quobyte-294f42c8-b08d-4fec-b8c7-d837ecaa578e" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-quobyte-294f42c8-b08d-4fec-b8c7-d837ecaa578e" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[928bef48-3c71-45ff-bd3f-a53f08d74070]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-294f42c8-b08d-4fec-b8c7-d837ecaa578e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:34 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-294f42c8-b08d-4fec-b8c7-d837ecaa578e Apr 07 06:15:34 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:34 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ccd73fdb-1ffc-4c48-bca7-124bd848dbdf tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-233eae86-59a0-4779-b6c2-89d0c21635ee -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a" returned: 0 in 0.513s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:34 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-ccd73fdb-1ffc-4c48-bca7-124bd848dbdf tempest-CreateVolumesFromSnapshotTest-2096536899 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a is being set with open permissions: ugo+rw Apr 07 06:15:34 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ccd73fdb-1ffc-4c48-bca7-124bd848dbdf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:34 devstack sudo[90085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a Apr 07 06:15:34 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:35 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-294f42c8-b08d-4fec-b8c7-d837ecaa578e" returned: 0 in 0.655s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-294f42c8-b08d-4fec-b8c7-d837ecaa578e {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:35 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-294f42c8-b08d-4fec-b8c7-d837ecaa578e Apr 07 06:15:35 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:35 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ccd73fdb-1ffc-4c48-bca7-124bd848dbdf tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a" returned: 0 in 0.564s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ccd73fdb-1ffc-4c48-bca7-124bd848dbdf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:35 devstack sudo[90093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.info Apr 07 06:15:35 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:35 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-294f42c8-b08d-4fec-b8c7-d837ecaa578e" returned: 0 in 0.556s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:35 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-quobyte-294f42c8-b08d-4fec-b8c7-d837ecaa578e" released by "delete_volume" :: held 1.232s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:35 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] Created reservations ['dbfd55db-102a-4101-b474-4f6dc54a0e54', '763c50a4-2014-4452-8d3e-219633f11ccc', '8c4fc4df-9930-423d-b098-84b82a956d77', '53f6ac75-8fdb-42c2-8876-97af9797611e'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:35 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:35 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:15:35 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:35 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ccd73fdb-1ffc-4c48-bca7-124bd848dbdf tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.info" returned: 0 in 0.541s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:35 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-ccd73fdb-1ffc-4c48-bca7-124bd848dbdf tempest-CreateVolumesFromSnapshotTest-2096536899 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.info is being set with open permissions: ugo+rw Apr 07 06:15:35 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ccd73fdb-1ffc-4c48-bca7-124bd848dbdf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:35 devstack sudo[90099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.info Apr 07 06:15:35 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:36 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.434s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:36 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] Deleted volume successfully. Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-b7f5299f-4cd8-4d22-8495-640951b34686 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-294f42c8-b08d-4fec-b8c7-d837ecaa578e-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:36 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-ccd73fdb-1ffc-4c48-bca7-124bd848dbdf tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.info" returned: 0 in 0.508s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-ccd73fdb-1ffc-4c48-bca7-124bd848dbdf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.418s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.278s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Acquiring lock "cinder-quobyte-8b74092b-aefd-441f-b69d-b512bb995987-a04599da-7d09-49f3-b068-483aac83ae0f" by "_create_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-8b74092b-aefd-441f-b69d-b512bb995987-a04599da-7d09-49f3-b068-483aac83ae0f" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Creating volume a04599da-7d09-49f3-b068-483aac83ae0f from snapshot 8b74092b-aefd-441f-b69d-b512bb995987 {{(pid=82475) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Acquiring lock "cinder-quobyte-a04599da-7d09-49f3-b068-483aac83ae0f" by "_copy_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:36 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-ccd73fdb-1ffc-4c48-bca7-124bd848dbdf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Create snapshot completed successfully Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-a04599da-7d09-49f3-b068-483aac83ae0f" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] snapshot: 8b74092b-aefd-441f-b69d-b512bb995987, volume: a04599da-7d09-49f3-b068-483aac83ae0f, {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df9f4ef-c8c5-419d-96ca-7a9cec08a4eb]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:36 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987 Apr 07 06:15:36 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "cinder-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "cinder-quobyte-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-quobyte-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc1e7f7-d780-46fb-9d8f-ab1409329de0]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:36 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:36 devstack sudo[90105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b Apr 07 06:15:36 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Flow 'volume_create_manager' (1ff19af3-0eb4-476c-a5eb-9823075c4e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:37 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4eb32a2-a584-441d-b133-86fdd7dee0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4eb32a2-a584-441d-b133-86fdd7dee0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1948148621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d252bf79-b606-485a-9135-3469249c025d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582963d90bc24e7e8b292f6cf65453b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:37Z,use_quota=True,user_id='dc649b16c4c94ce5a43fa4f9f9b3158b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578f7b57-7725-472e-a67f-e623605d9ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578f7b57-7725-472e-a67f-e623605d9ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73fde42-f15a-47f2-9c7c-7e564402a79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73fde42-f15a-47f2-9c7c-7e564402a79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd252bf79-b606-485a-9135-3469249c025d', 'volume_name': 'volume-d252bf79-b606-485a-9135-3469249c025d', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c551b4f1-11cb-4fdf-a7e4-124a4aaa35e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c551b4f1-11cb-4fdf-a7e4-124a4aaa35e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adec5193-b303-4b9b-98ba-5085d916bccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Volume d252bf79-b606-485a-9135-3469249c025d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d252bf79-b606-485a-9135-3469249c025d', 'volume_size': 1} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987" returned: 0 in 0.659s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] will copy from snapshot at /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Creating direct copy from snapshot {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[755e3717-629c-4f37-b3df-d3f3b4111346]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:37 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 Apr 07 06:15:37 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Flow 'volume_create_manager' (b539bb8e-2be3-431f-b121-ac1e79564268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0442aa62-76c5-4db1-9105-26d288c7eec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0442aa62-76c5-4db1-9105-26d288c7eec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-645374539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d688154-4dd8-4675-a9ce-7d7694701a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2487db81a8444ba38e8bdc7057fdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:37Z,use_quota=True,user_id='6ee463f2880d4a2393c53f35d87d09b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5e9491-f3d4-40b2-b5f1-17fab84e984b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5e9491-f3d4-40b2-b5f1-17fab84e984b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63646cd-5718-4f58-94c2-d8042d9a7a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63646cd-5718-4f58-94c2-d8042d9a7a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d688154-4dd8-4675-a9ce-7d7694701a30', 'volume_name': 'volume-3d688154-4dd8-4675-a9ce-7d7694701a30', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02738c7-6ddf-4774-a033-95946327711d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02738c7-6ddf-4774-a033-95946327711d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7aa8023-b045-49d5-b665-017db1c63aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Volume 3d688154-4dd8-4675-a9ce-7d7694701a30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d688154-4dd8-4675-a9ce-7d7694701a30', 'volume_size': 1} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b" returned: 0 in 0.694s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:37 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b Apr 07 06:15:37 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Flow 'volume_create_manager' (0c2c6f3c-bfaa-4c23-a26c-425b575527e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b93cef-369d-4cf8-8b3a-826c184cdbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b93cef-369d-4cf8-8b3a-826c184cdbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-697798223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2487db81a8444ba38e8bdc7057fdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:37Z,use_quota=True,user_id='6ee463f2880d4a2393c53f35d87d09b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7447c6-300d-487c-9d64-354ab2dfd5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7447c6-300d-487c-9d64-354ab2dfd5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54874b1c-9a72-466c-aed4-0361c23ad219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54874b1c-9a72-466c-aed4-0361c23ad219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8', 'volume_name': 'volume-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c726102a-abc8-4fc6-9bde-e45f997441a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c726102a-abc8-4fc6-9bde-e45f997441a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82f40b0-69c8-441f-b7cc-b3942bcbf7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Volume 66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8', 'volume_size': 1} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Flow 'volume_create_manager' (da1b34c4-4493-4d63-9bc8-11822409f505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2741721-5f11-4fdb-ba1a-b6fa0bfc2c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2741721-5f11-4fdb-ba1a-b6fa0bfc2c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2129463607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640f7b31-2adb-4274-826c-037df4adbc1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2487db81a8444ba38e8bdc7057fdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:38Z,use_quota=True,user_id='6ee463f2880d4a2393c53f35d87d09b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb9e824-2335-4831-b2b8-0bf455faa27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb9e824-2335-4831-b2b8-0bf455faa27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9ab3ad-42df-4092-b45f-bc225ddcb9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9ab3ad-42df-4092-b45f-bc225ddcb9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '640f7b31-2adb-4274-826c-037df4adbc1a', 'volume_name': 'volume-640f7b31-2adb-4274-826c-037df4adbc1a', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a0ccde-16c9-4eaf-9d7c-5469ee1625c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a0ccde-16c9-4eaf-9d7c-5469ee1625c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62909de0-e6a6-4da6-8c0e-196718765cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:37 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Volume 640f7b31-2adb-4274-826c-037df4adbc1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-640f7b31-2adb-4274-826c-037df4adbc1a', 'volume_size': 1} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:37 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3" returned: 0 in 0.671s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.utils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Path /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a04599da-7d09-49f3-b068-483aac83ae0f not found in is_blk_device check {{(pid=82475) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a04599da-7d09-49f3-b068-483aac83ae0f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:37 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a04599da-7d09-49f3-b068-483aac83ae0f Apr 07 06:15:37 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:37 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b" returned: 0 in 0.486s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-quobyte-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b" released by "delete_volume" :: held 1.205s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] Created reservations ['ecb4ce45-07b9-4d96-afee-1972469eacf7', '8a19ae11-ba81-4ed1-a348-74fe118b5496', '71fa565d-cfc4-4c84-a715-1269a094f2b8', '96cd059f-5f66-4d3d-99f9-353ae9800c2b'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:37 devstack sudo[90124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:15:37 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:37 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Flow 'volume_create_manager' (cd15c24a-35fc-40b9-9417-672a12980dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02de12a0-67d8-48fd-b163-9358bda93db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02de12a0-67d8-48fd-b163-9358bda93db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-831681956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83dec15-1ce8-48ae-adbf-397fe4fa029c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2487db81a8444ba38e8bdc7057fdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:38Z,use_quota=True,user_id='6ee463f2880d4a2393c53f35d87d09b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2395eac0-4e48-4f95-9ecd-1908f0f88b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2395eac0-4e48-4f95-9ecd-1908f0f88b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169c2e8b-b461-4475-a3cf-76329bf24fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169c2e8b-b461-4475-a3cf-76329bf24fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd83dec15-1ce8-48ae-adbf-397fe4fa029c', 'volume_name': 'volume-d83dec15-1ce8-48ae-adbf-397fe4fa029c', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35be2401-ec9c-4cdd-9ec3-b48d969851bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35be2401-ec9c-4cdd-9ec3-b48d969851bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b0e8d1-c624-41b2-962d-cef80614004e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:38 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Volume d83dec15-1ce8-48ae-adbf-397fe4fa029c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d83dec15-1ce8-48ae-adbf-397fe4fa029c', 'volume_size': 1} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Flow 'volume_create_manager' (51ce7019-7757-4ba7-b9a3-3d6fd02c8d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d362585-44fc-4988-8b9a-30ec134fa47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d362585-44fc-4988-8b9a-30ec134fa47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-503892066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae73402b-6838-43dc-8c7d-2d3f138fe055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2487db81a8444ba38e8bdc7057fdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:38Z,use_quota=True,user_id='6ee463f2880d4a2393c53f35d87d09b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabfb44d-b1f0-472a-a84e-360f5e053bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabfb44d-b1f0-472a-a84e-360f5e053bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59b09295-9f4a-452a-ab01-cfffc2c0a5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59b09295-9f4a-452a-ab01-cfffc2c0a5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae73402b-6838-43dc-8c7d-2d3f138fe055', 'volume_name': 'volume-ae73402b-6838-43dc-8c7d-2d3f138fe055', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a129a343-5aed-477a-93a2-edb44e8e5e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a129a343-5aed-477a-93a2-edb44e8e5e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69cfd63c-c0b5-40a6-8bdb-dfb9ecb90049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:38 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Volume ae73402b-6838-43dc-8c7d-2d3f138fe055: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae73402b-6838-43dc-8c7d-2d3f138fe055', 'volume_size': 1} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:38 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.589s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:38 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] Deleted volume successfully. Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fb0e0eac-2cb1-4ddc-a9e7-ba93701e767a tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-dbe4b1fb-256a-4c35-a9b9-1db9a112ff8b-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "cinder-6bf82820-f9f4-4d7f-ab96-c3dc65283847-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-6bf82820-f9f4-4d7f-ab96-c3dc65283847-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "cinder-quobyte-6bf82820-f9f4-4d7f-ab96-c3dc65283847" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-quobyte-6bf82820-f9f4-4d7f-ab96-c3dc65283847" acquired by "delete_volume" :: waited 0.025s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5429ac-5c9c-4d1a-94c0-1bdcd75ad636]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:38 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6bf82820-f9f4-4d7f-ab96-c3dc65283847 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:39 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6bf82820-f9f4-4d7f-ab96-c3dc65283847 Apr 07 06:15:39 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:39 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6bf82820-f9f4-4d7f-ab96-c3dc65283847" returned: 0 in 0.713s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:39 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6bf82820-f9f4-4d7f-ab96-c3dc65283847 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:39 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6bf82820-f9f4-4d7f-ab96-c3dc65283847 Apr 07 06:15:39 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:40 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a04599da-7d09-49f3-b068-483aac83ae0f" returned: 0 in 2.523s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:40 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[83392396-0a40-45ef-8ea6-f043cef8dbc2]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:40 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 Apr 07 06:15:40 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:40 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-6bf82820-f9f4-4d7f-ab96-c3dc65283847" returned: 0 in 0.883s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:40 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-quobyte-6bf82820-f9f4-4d7f-ab96-c3dc65283847" released by "delete_volume" :: held 1.633s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:40 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] Created reservations ['a1a57af1-6c46-4f33-89b9-5af04e1ab3f5', '6824f989-a94b-4efd-9d0d-8772c4095592', 'eec80e10-3f39-4d51-b244-7e0ac1197abd', '5e9b6bec-d254-404a-9742-581071f89c82'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:40 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:40 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:15:40 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:40 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3" returned: 0 in 0.539s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:40 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Image conversion details: src /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3, size 1024.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a04599da-7d09-49f3-b068-483aac83ae0f {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:15:40 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Converted 1024.00 MB image at 405.72 MB/s Apr 07 06:15:40 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a04599da-7d09-49f3-b068-483aac83ae0f is being set with open permissions: ugo+rw Apr 07 06:15:40 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a04599da-7d09-49f3-b068-483aac83ae0f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:40 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a04599da-7d09-49f3-b068-483aac83ae0f Apr 07 06:15:40 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:41 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.403s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:41 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] Deleted volume successfully. Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-dd6a51f4-3f10-43b4-bd85-f5524b62ad05 tempest-CreateVolumesFromImageTest-1527787716 None] Lock "cinder-6bf82820-f9f4-4d7f-ab96-c3dc65283847-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:41 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a04599da-7d09-49f3-b068-483aac83ae0f" returned: 0 in 0.417s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-a04599da-7d09-49f3-b068-483aac83ae0f" released by "_copy_volume_from_snapshot" :: held 4.879s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-8b74092b-aefd-441f-b69d-b512bb995987-a04599da-7d09-49f3-b068-483aac83ae0f" released by "_create_volume_from_snapshot" :: held 4.910s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.929s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.190s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1948148621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d252bf79-b606-485a-9135-3469249c025d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582963d90bc24e7e8b292f6cf65453b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:37Z,use_quota=True,user_id='dc649b16c4c94ce5a43fa4f9f9b3158b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Creating volume d252bf79-b606-485a-9135-3469249c025d {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:41 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:41 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d 1073741824 Apr 07 06:15:41 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e355a29-650e-4564-8802-a49b65c016d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a04599da-7d09-49f3-b068-483aac83ae0f', 'volume_size': 1, 'snapshot_id': '8b74092b-aefd-441f-b69d-b512bb995987'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9e3cbc-974c-462d-8091-6e9e7a40a5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:41 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Volume volume-a04599da-7d09-49f3-b068-483aac83ae0f (a04599da-7d09-49f3-b068-483aac83ae0f): created successfully Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9e3cbc-974c-462d-8091-6e9e7a40a5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Flow 'volume_create_manager' (7d89e6fb-7e91-4fd6-981b-eac77b5ebf7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:41 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-c21a40dd-fdac-4eea-b6c2-dc10eff80752 tempest-VolumeDependencyTests-794886482 None] Created volume successfully. Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] Acquiring lock "cinder-8b74092b-aefd-441f-b69d-b512bb995987-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] Lock "cinder-8b74092b-aefd-441f-b69d-b512bb995987-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] Acquiring lock "cinder-quobyte-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] Acquiring lock "cinder-quobyte-8b74092b-aefd-441f-b69d-b512bb995987" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-8b74092b-aefd-441f-b69d-b512bb995987" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] Deleting offline snapshot 8b74092b-aefd-441f-b69d-b512bb995987 of volume ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] snapshot_file for this snap is: volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[6940c438-8b82-48c3-ae4d-fff62381deab]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:41 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:41 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987 Apr 07 06:15:41 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:42 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d 1073741824" returned: 0 in 0.665s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:42 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d Apr 07 06:15:42 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:42 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987" returned: 0 in 0.571s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e98fb0-20ff-414d-8eb4-f5f38b0c97a7]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:42 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 Apr 07 06:15:42 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:42 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d" returned: 0 in 0.458s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.110s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-645374539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d688154-4dd8-4675-a9ce-7d7694701a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2487db81a8444ba38e8bdc7057fdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:37Z,use_quota=True,user_id='6ee463f2880d4a2393c53f35d87d09b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Creating volume 3d688154-4dd8-4675-a9ce-7d7694701a30 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:42 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-3d688154-4dd8-4675-a9ce-7d7694701a30 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adec5193-b303-4b9b-98ba-5085d916bccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d252bf79-b606-485a-9135-3469249c025d', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:42 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-3d688154-4dd8-4675-a9ce-7d7694701a30 1073741824 Apr 07 06:15:42 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b662e10-57be-4113-82d0-4f24e68316b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:42 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Volume volume-d252bf79-b606-485a-9135-3469249c025d (d252bf79-b606-485a-9135-3469249c025d): created successfully Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b662e10-57be-4113-82d0-4f24e68316b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Flow 'volume_create_manager' (1ff19af3-0eb4-476c-a5eb-9823075c4e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:42 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-10f0d14c-cea9-4f3b-a658-93bc224edf12 tempest-SnapshotDependencyTests-771360129 None] Created volume successfully. Apr 07 06:15:42 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3" returned: 0 in 0.542s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:42 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987 Apr 07 06:15:42 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Flow 'volume_create_manager' (8bf23c82-bc8a-4b8c-96f9-bc779cf52535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f912f1-c522-466a-bda7-c8d4ce2c864f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f912f1-c522-466a-bda7-c8d4ce2c864f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2106395027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb06065-269f-46e8-b4c7-fc158ebd9e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb195141ce88476681b719f277244864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:43Z,use_quota=True,user_id='88b9a7381855471f943e6b254cf888cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16f068c-1e47-4d11-beb1-06cdde24b220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16f068c-1e47-4d11-beb1-06cdde24b220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4507533-6d30-4d1f-ae33-33b5f975563c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4507533-6d30-4d1f-ae33-33b5f975563c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bb06065-269f-46e8-b4c7-fc158ebd9e6b', 'volume_name': 'volume-0bb06065-269f-46e8-b4c7-fc158ebd9e6b', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df558576-27f7-44d6-8dda-13398b61f514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df558576-27f7-44d6-8dda-13398b61f514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1992745e-973b-4444-9f30-f106819e2757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:42 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Volume 0bb06065-269f-46e8-b4c7-fc158ebd9e6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bb06065-269f-46e8-b4c7-fc158ebd9e6b', 'volume_size': 1} Apr 07 06:15:42 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:43 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-3d688154-4dd8-4675-a9ce-7d7694701a30 1073741824" returned: 0 in 0.544s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-3d688154-4dd8-4675-a9ce-7d7694701a30 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:43 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-3d688154-4dd8-4675-a9ce-7d7694701a30 Apr 07 06:15:43 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:43 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987" returned: 0 in 0.535s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:43 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987 Apr 07 06:15:43 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:43 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-3d688154-4dd8-4675-a9ce-7d7694701a30" returned: 0 in 0.473s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.893s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-697798223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2487db81a8444ba38e8bdc7057fdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:37Z,use_quota=True,user_id='6ee463f2880d4a2393c53f35d87d09b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Creating volume 66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:43 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:43 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8 1073741824 Apr 07 06:15:43 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7aa8023-b045-49d5-b665-017db1c63aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d688154-4dd8-4675-a9ce-7d7694701a30', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283700d0-2516-49bf-80d0-9edf22f0855f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:43 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Volume volume-3d688154-4dd8-4675-a9ce-7d7694701a30 (3d688154-4dd8-4675-a9ce-7d7694701a30): created successfully Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283700d0-2516-49bf-80d0-9edf22f0855f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Flow 'volume_create_manager' (b539bb8e-2be3-431f-b121-ac1e79564268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:43 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-5764f6f2-1f96-4b42-ac9c-46ddcbbe1722 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Created volume successfully. Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bf185265-ffe6-41ef-89c0-b8618e36e82c tempest-SnapshotDependencyTests-771360129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:43 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3.8b74092b-aefd-441f-b69d-b512bb995987" returned: 0 in 0.511s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-8b74092b-aefd-441f-b69d-b512bb995987" released by "_delete_snapshot" :: held 2.210s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3" released by "delete_snapshot" :: held 2.231s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] Created reservations ['ee0a1d92-9a8e-4b26-9e2b-11c484c6961e', '222bb74e-9c3f-47ae-870f-7358992040cf', '715ed5b1-766d-471a-8c29-677b1700173e', '7fb812f6-b04b-4522-a499-d13adbdc5d5d'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:43 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] Delete snapshot completed successfully. Apr 07 06:15:43 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-43ff3ef1-e9db-44d3-ba2f-f3c2d9d50fa4 tempest-VolumeDependencyTests-794886482 None] Lock "cinder-8b74092b-aefd-441f-b69d-b512bb995987-delete_snapshot" released by "delete_snapshot" :: held 2.317s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:44 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8 1073741824" returned: 0 in 0.508s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:44 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8 Apr 07 06:15:44 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:44 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8" returned: 0 in 0.366s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.647s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2129463607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640f7b31-2adb-4274-826c-037df4adbc1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2487db81a8444ba38e8bdc7057fdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:38Z,use_quota=True,user_id='6ee463f2880d4a2393c53f35d87d09b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Creating volume 640f7b31-2adb-4274-826c-037df4adbc1a {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:44 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-640f7b31-2adb-4274-826c-037df4adbc1a 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82f40b0-69c8-441f-b7cc-b3942bcbf7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:44 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-640f7b31-2adb-4274-826c-037df4adbc1a 1073741824 Apr 07 06:15:44 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a198aead-c9da-4672-929b-5ded9d312739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:44 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Volume volume-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8 (66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8): created successfully Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a198aead-c9da-4672-929b-5ded9d312739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Flow 'volume_create_manager' (0c2c6f3c-bfaa-4c23-a26c-425b575527e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:44 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d3ca3135-baad-4a97-b947-e69e04caa7b6 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Created volume successfully. Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] Acquiring lock "cinder-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] Lock "cinder-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] Acquiring lock "cinder-quobyte-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3" acquired by "delete_volume" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd26188-5392-4a22-9647-a0a4a26259db]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:44 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 Apr 07 06:15:44 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:44 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:44 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-640f7b31-2adb-4274-826c-037df4adbc1a 1073741824" returned: 0 in 0.524s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-640f7b31-2adb-4274-826c-037df4adbc1a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:45 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-640f7b31-2adb-4274-826c-037df4adbc1a Apr 07 06:15:45 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:45 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3" returned: 0 in 0.510s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:45 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3 Apr 07 06:15:45 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:45 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-640f7b31-2adb-4274-826c-037df4adbc1a" returned: 0 in 0.394s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.345s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-831681956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83dec15-1ce8-48ae-adbf-397fe4fa029c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2487db81a8444ba38e8bdc7057fdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:38Z,use_quota=True,user_id='6ee463f2880d4a2393c53f35d87d09b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Creating volume d83dec15-1ce8-48ae-adbf-397fe4fa029c {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:45 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d83dec15-1ce8-48ae-adbf-397fe4fa029c 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62909de0-e6a6-4da6-8c0e-196718765cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-640f7b31-2adb-4274-826c-037df4adbc1a', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ffac9b-e6a3-4dc8-9189-c87a7ab926d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:45 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d83dec15-1ce8-48ae-adbf-397fe4fa029c 1073741824 Apr 07 06:15:45 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:45 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Volume volume-640f7b31-2adb-4274-826c-037df4adbc1a (640f7b31-2adb-4274-826c-037df4adbc1a): created successfully Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ffac9b-e6a3-4dc8-9189-c87a7ab926d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Flow 'volume_create_manager' (da1b34c4-4493-4d63-9bc8-11822409f505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:45 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-e96d5e99-20a3-4717-8a40-ba254a401ecf tempest-CreateVolumesFromSnapshotTest-2096536899 None] Created volume successfully. Apr 07 06:15:45 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3" returned: 0 in 0.406s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3" released by "delete_volume" :: held 0.946s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] Created reservations ['46cd3cf0-cfae-4d9d-9fdd-20c665d32b0c', 'b54fc988-cfec-4f8f-818e-d54a7fc05f28', '824b4eea-bde1-4c93-aa53-9c92a1b88e76', '655407b5-98a8-4eae-b2b8-49d742d2b18b'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:45 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:15:45 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:45 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d83dec15-1ce8-48ae-adbf-397fe4fa029c 1073741824" returned: 0 in 0.513s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:45 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d83dec15-1ce8-48ae-adbf-397fe4fa029c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:45 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d83dec15-1ce8-48ae-adbf-397fe4fa029c Apr 07 06:15:45 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Flow 'volume_create_manager' (9a4882c4-28d6-4fee-8093-c638ec537502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e65cf18-b52d-4e53-acdc-b8e120ea0ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e65cf18-b52d-4e53-acdc-b8e120ea0ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-754887251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b32ef1-28a5-4e00-8594-fcfe046a0e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87867cb9c9c24c62973ae02fbcfb9d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:46Z,use_quota=True,user_id='83113b23b7a842b688a9b71ab7b9f2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef204fd-0ea4-45cb-a062-1bea4faf3d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef204fd-0ea4-45cb-a062-1bea4faf3d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c1e5e6-3e9c-4058-935e-d762401b37dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c1e5e6-3e9c-4058-935e-d762401b37dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9b32ef1-28a5-4e00-8594-fcfe046a0e7c', 'volume_name': 'volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591bcb92-1966-4fad-9531-987a1203ffeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591bcb92-1966-4fad-9531-987a1203ffeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b55a83-83cc-4b0a-8c7b-b73c7d1ef665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Volume c9b32ef1-28a5-4e00-8594-fcfe046a0e7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c', 'volume_size': 1} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:46 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.502s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:46 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] Deleted volume successfully. Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-4eefd1d8-e2c2-4e89-bca6-261eaa402ba8 tempest-VolumeDependencyTests-794886482 None] Lock "cinder-ee410d8f-2ab8-43a7-9de1-cfc7e22925b3-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:46 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d83dec15-1ce8-48ae-adbf-397fe4fa029c" returned: 0 in 0.404s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.093s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-503892066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae73402b-6838-43dc-8c7d-2d3f138fe055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2487db81a8444ba38e8bdc7057fdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:38Z,use_quota=True,user_id='6ee463f2880d4a2393c53f35d87d09b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Creating volume ae73402b-6838-43dc-8c7d-2d3f138fe055 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:46 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ae73402b-6838-43dc-8c7d-2d3f138fe055 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b0e8d1-c624-41b2-962d-cef80614004e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d83dec15-1ce8-48ae-adbf-397fe4fa029c', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ae73402b-6838-43dc-8c7d-2d3f138fe055 1073741824 Apr 07 06:15:46 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a147cd-3bc8-4907-bb70-68b04cac5dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:46 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Volume volume-d83dec15-1ce8-48ae-adbf-397fe4fa029c (d83dec15-1ce8-48ae-adbf-397fe4fa029c): created successfully Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a147cd-3bc8-4907-bb70-68b04cac5dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Flow 'volume_create_manager' (cd15c24a-35fc-40b9-9417-672a12980dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:46 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-4910ab95-647b-4067-8e7f-dc13535758cc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Created volume successfully. Apr 07 06:15:46 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ae73402b-6838-43dc-8c7d-2d3f138fe055 1073741824" returned: 0 in 0.475s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:46 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ae73402b-6838-43dc-8c7d-2d3f138fe055 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:46 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ae73402b-6838-43dc-8c7d-2d3f138fe055 Apr 07 06:15:46 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:47 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ae73402b-6838-43dc-8c7d-2d3f138fe055" returned: 0 in 0.371s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.241s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2106395027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb06065-269f-46e8-b4c7-fc158ebd9e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb195141ce88476681b719f277244864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:43Z,use_quota=True,user_id='88b9a7381855471f943e6b254cf888cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Creating volume 0bb06065-269f-46e8-b4c7-fc158ebd9e6b {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:47 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0bb06065-269f-46e8-b4c7-fc158ebd9e6b 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69cfd63c-c0b5-40a6-8bdb-dfb9ecb90049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae73402b-6838-43dc-8c7d-2d3f138fe055', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:47 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0bb06065-269f-46e8-b4c7-fc158ebd9e6b 1073741824 Apr 07 06:15:47 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7d6251-023c-4c19-a9f9-6d011e632def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:47 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Volume volume-ae73402b-6838-43dc-8c7d-2d3f138fe055 (ae73402b-6838-43dc-8c7d-2d3f138fe055): created successfully Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7d6251-023c-4c19-a9f9-6d011e632def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Flow 'volume_create_manager' (51ce7019-7757-4ba7-b9a3-3d6fd02c8d7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:47 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-28de5084-8260-43e3-8d23-336d93049ab4 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Created volume successfully. Apr 07 06:15:47 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0bb06065-269f-46e8-b4c7-fc158ebd9e6b 1073741824" returned: 0 in 0.437s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0bb06065-269f-46e8-b4c7-fc158ebd9e6b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:47 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0bb06065-269f-46e8-b4c7-fc158ebd9e6b Apr 07 06:15:47 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "cinder-ae73402b-6838-43dc-8c7d-2d3f138fe055-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:47 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-ae73402b-6838-43dc-8c7d-2d3f138fe055-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "cinder-quobyte-ae73402b-6838-43dc-8c7d-2d3f138fe055" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-quobyte-ae73402b-6838-43dc-8c7d-2d3f138fe055" acquired by "delete_volume" :: waited 0.020s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc309e3-5e69-481d-8fb8-1364c2935501]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ae73402b-6838-43dc-8c7d-2d3f138fe055 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:48 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0bb06065-269f-46e8-b4c7-fc158ebd9e6b" returned: 0 in 0.426s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bf185265-ffe6-41ef-89c0-b8618e36e82c tempest-SnapshotDependencyTests-771360129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.472s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:48 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ae73402b-6838-43dc-8c7d-2d3f138fe055 Apr 07 06:15:48 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1992745e-973b-4444-9f30-f106819e2757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb06065-269f-46e8-b4c7-fc158ebd9e6b', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f6189c-9338-4a73-ac9d-39afd2e6c960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-bf185265-ffe6-41ef-89c0-b8618e36e82c tempest-SnapshotDependencyTests-771360129 None] Creating offline snapshot d3690a92-6642-4541-9066-290d5489b22d of volume d252bf79-b606-485a-9135-3469249c025d {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:15:48 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Volume volume-0bb06065-269f-46e8-b4c7-fc158ebd9e6b (0bb06065-269f-46e8-b4c7-fc158ebd9e6b): created successfully Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f6189c-9338-4a73-ac9d-39afd2e6c960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Flow 'volume_create_manager' (8bf23c82-bc8a-4b8c-96f9-bc779cf52535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34b257a-0d46-4fc7-a447-73b766c3d469]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bf185265-ffe6-41ef-89c0-b8618e36e82c tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:48 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-6d33ce28-448c-493f-ba46-1a9a921be465 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Created volume successfully. Apr 07 06:15:48 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d Apr 07 06:15:48 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:48 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ae73402b-6838-43dc-8c7d-2d3f138fe055" returned: 0 in 0.478s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ae73402b-6838-43dc-8c7d-2d3f138fe055 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:48 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ae73402b-6838-43dc-8c7d-2d3f138fe055 Apr 07 06:15:48 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:48 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bf185265-ffe6-41ef-89c0-b8618e36e82c tempest-SnapshotDependencyTests-771360129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d" returned: 0 in 0.485s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bf185265-ffe6-41ef-89c0-b8618e36e82c tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:48 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d 1G Apr 07 06:15:48 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:48 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-ae73402b-6838-43dc-8c7d-2d3f138fe055" returned: 0 in 0.393s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-quobyte-ae73402b-6838-43dc-8c7d-2d3f138fe055" released by "delete_volume" :: held 0.891s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:48 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Created reservations ['891db27a-a51e-4e6d-be45-b02fa9de363c', '3821d709-bff0-408d-9fa2-040ad0416743', 'aa657946-3bd9-423f-9cbc-4e4a3c057150', '470cd1e0-6f5f-441d-ada9-c59355b24751'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:49 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:15:49 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "cinder-d83dec15-1ce8-48ae-adbf-397fe4fa029c-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-d83dec15-1ce8-48ae-adbf-397fe4fa029c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "cinder-quobyte-d83dec15-1ce8-48ae-adbf-397fe4fa029c" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-quobyte-d83dec15-1ce8-48ae-adbf-397fe4fa029c" acquired by "delete_volume" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[843bd090-b667-4310-971b-c993ffc7c013]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d83dec15-1ce8-48ae-adbf-397fe4fa029c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:49 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bf185265-ffe6-41ef-89c0-b8618e36e82c tempest-SnapshotDependencyTests-771360129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d 1G" returned: 0 in 0.555s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bf185265-ffe6-41ef-89c0-b8618e36e82c tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d252bf79-b606-485a-9135-3469249c025d -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:49 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d252bf79-b606-485a-9135-3469249c025d -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d Apr 07 06:15:49 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:49 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d83dec15-1ce8-48ae-adbf-397fe4fa029c Apr 07 06:15:49 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:49 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.442s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:49 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Deleted volume successfully. Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-45e1ed7e-ef9e-47aa-bbe4-4c806d10d5dc tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-ae73402b-6838-43dc-8c7d-2d3f138fe055-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Flow 'volume_create_manager' (a8a193c7-9401-4bda-8dfe-64c85880fdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d30185-edfa-4a57-b0ad-90a0e3e96196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d30185-edfa-4a57-b0ad-90a0e3e96196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1337372793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8010b7b-e7c4-466d-aac3-cb5e8130c8ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb195141ce88476681b719f277244864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:50Z,use_quota=True,user_id='88b9a7381855471f943e6b254cf888cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21972cd8-aee0-40ae-ab41-551e4b51f416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21972cd8-aee0-40ae-ab41-551e4b51f416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8fc80e5-d55f-4484-b6d1-84b9d30bcbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8fc80e5-d55f-4484-b6d1-84b9d30bcbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8010b7b-e7c4-466d-aac3-cb5e8130c8ea', 'volume_name': 'volume-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca4a16c-bf55-49cc-81b1-150c227cf8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca4a16c-bf55-49cc-81b1-150c227cf8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4adbc7-1d75-42d9-84a0-3bc4e791d213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:49 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Volume b8010b7b-e7c4-466d-aac3-cb5e8130c8ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea', 'volume_size': 1} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:49 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bf185265-ffe6-41ef-89c0-b8618e36e82c tempest-SnapshotDependencyTests-771360129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d252bf79-b606-485a-9135-3469249c025d -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d" returned: 0 in 0.494s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:49 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-bf185265-ffe6-41ef-89c0-b8618e36e82c tempest-SnapshotDependencyTests-771360129 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d is being set with open permissions: ugo+rw Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bf185265-ffe6-41ef-89c0-b8618e36e82c tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:49 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d Apr 07 06:15:49 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:49 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d83dec15-1ce8-48ae-adbf-397fe4fa029c" returned: 0 in 0.580s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d83dec15-1ce8-48ae-adbf-397fe4fa029c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:49 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d83dec15-1ce8-48ae-adbf-397fe4fa029c Apr 07 06:15:49 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Flow 'volume_create_manager' (c1d754b0-e22c-427c-a6ca-7c44b61bd814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad0b7a4-4c7a-40ba-9d1d-47382a73c2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad0b7a4-4c7a-40ba-9d1d-47382a73c2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-289399628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7029c05d-689f-4448-a6f8-8576cb6e143a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb195141ce88476681b719f277244864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:50Z,use_quota=True,user_id='88b9a7381855471f943e6b254cf888cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbaad270-cfef-4386-8741-eace9e9bf71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbaad270-cfef-4386-8741-eace9e9bf71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e03b6ba6-4d84-4ee5-ae4d-d64e725a4f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e03b6ba6-4d84-4ee5-ae4d-d64e725a4f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7029c05d-689f-4448-a6f8-8576cb6e143a', 'volume_name': 'volume-7029c05d-689f-4448-a6f8-8576cb6e143a', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5998719-70fb-41bd-94bb-44b1bc3c022e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5998719-70fb-41bd-94bb-44b1bc3c022e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672e6ed4-435c-4036-89d9-e79867131de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:49 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Volume 7029c05d-689f-4448-a6f8-8576cb6e143a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7029c05d-689f-4448-a6f8-8576cb6e143a', 'volume_size': 1} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:49 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Flow 'volume_create_manager' (6ed44123-a6b0-4c25-a91a-3cf0c3121505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc31f25d-515c-4f7f-acb5-9ca09c4f7582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc31f25d-515c-4f7f-acb5-9ca09c4f7582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-817582661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ebb04c-e57c-4875-8379-766fa1d7fcf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb195141ce88476681b719f277244864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:50Z,use_quota=True,user_id='88b9a7381855471f943e6b254cf888cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c416af-4ca1-41e1-8250-89a2412fce64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c416af-4ca1-41e1-8250-89a2412fce64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7923437b-e1c9-4a3f-8bec-999254b94cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7923437b-e1c9-4a3f-8bec-999254b94cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65ebb04c-e57c-4875-8379-766fa1d7fcf8', 'volume_name': 'volume-65ebb04c-e57c-4875-8379-766fa1d7fcf8', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a6a556-31f1-4bb6-87c2-351e91958ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a6a556-31f1-4bb6-87c2-351e91958ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc3973f-82ea-47b3-aa68-47bffac518bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:50 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Volume 65ebb04c-e57c-4875-8379-766fa1d7fcf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65ebb04c-e57c-4875-8379-766fa1d7fcf8', 'volume_size': 1} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:50 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bf185265-ffe6-41ef-89c0-b8618e36e82c tempest-SnapshotDependencyTests-771360129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d" returned: 0 in 0.443s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:50 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d83dec15-1ce8-48ae-adbf-397fe4fa029c" returned: 0 in 0.423s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bf185265-ffe6-41ef-89c0-b8618e36e82c tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:50 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.info Apr 07 06:15:50 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-quobyte-d83dec15-1ce8-48ae-adbf-397fe4fa029c" released by "delete_volume" :: held 1.064s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Flow 'volume_create_manager' (678642d4-8f0d-4291-b10e-005fa7c13ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf0a247-dd53-438b-b173-4521cec34478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf0a247-dd53-438b-b173-4521cec34478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1057825845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ef459f-5840-4a15-ae72-8d57370ac0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb195141ce88476681b719f277244864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:50Z,use_quota=True,user_id='88b9a7381855471f943e6b254cf888cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12893e05-0dca-4c54-87db-616733d62e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12893e05-0dca-4c54-87db-616733d62e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3b34b9-05bd-4f5c-b1d4-767d43331273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3b34b9-05bd-4f5c-b1d4-767d43331273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07ef459f-5840-4a15-ae72-8d57370ac0c3', 'volume_name': 'volume-07ef459f-5840-4a15-ae72-8d57370ac0c3', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6d141c-e183-4e39-a5cb-f4c5e10c102f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6d141c-e183-4e39-a5cb-f4c5e10c102f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db24776-dcbd-4e40-a71f-b9476d449abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:50 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Volume 07ef459f-5840-4a15-ae72-8d57370ac0c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07ef459f-5840-4a15-ae72-8d57370ac0c3', 'volume_size': 1} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Created reservations ['0fa0f9f3-f693-43ac-9ca8-cc4a67e959b2', '59f05a89-5e65-4b3c-8a02-9a3d4fc2cac9', '18390114-5bff-4810-b6d5-83b02df52ef3', 'b4364aa4-b6ac-433a-88d5-15d39347d413'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:50 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:15:50 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Flow 'volume_create_manager' (5b3fdf20-b3af-4e13-a6e1-882c6e33ba9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6359aebe-46e0-4357-a5e4-8acda228eb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6359aebe-46e0-4357-a5e4-8acda228eb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-60739426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae5786e-4412-4e41-8548-97a4d4d58e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb195141ce88476681b719f277244864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:50Z,use_quota=True,user_id='88b9a7381855471f943e6b254cf888cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682c4033-20e5-4584-a38c-c99c41ea64c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682c4033-20e5-4584-a38c-c99c41ea64c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45dd61ba-d8ac-420f-8c51-9789e95d9bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45dd61ba-d8ac-420f-8c51-9789e95d9bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dae5786e-4412-4e41-8548-97a4d4d58e31', 'volume_name': 'volume-dae5786e-4412-4e41-8548-97a4d4d58e31', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265aa9a7-a7fd-4c75-b362-0817252a7000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265aa9a7-a7fd-4c75-b362-0817252a7000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd39a44d-0b02-4a9f-b737-b81e2fb1dc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:50 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Volume dae5786e-4412-4e41-8548-97a4d4d58e31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dae5786e-4412-4e41-8548-97a4d4d58e31', 'volume_size': 1} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:50 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bf185265-ffe6-41ef-89c0-b8618e36e82c tempest-SnapshotDependencyTests-771360129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.info" returned: 0 in 0.463s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:50 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-bf185265-ffe6-41ef-89c0-b8618e36e82c tempest-SnapshotDependencyTests-771360129 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.info is being set with open permissions: ugo+rw Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bf185265-ffe6-41ef-89c0-b8618e36e82c tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:50 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.info Apr 07 06:15:50 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:50 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.380s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:50 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Deleted volume successfully. Apr 07 06:15:50 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1513589e-4ea4-4336-a511-162f7da0e478 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-d83dec15-1ce8-48ae-adbf-397fe4fa029c-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:51 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bf185265-ffe6-41ef-89c0-b8618e36e82c tempest-SnapshotDependencyTests-771360129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.info" returned: 0 in 0.409s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bf185265-ffe6-41ef-89c0-b8618e36e82c tempest-SnapshotDependencyTests-771360129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.942s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.904s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-754887251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b32ef1-28a5-4e00-8594-fcfe046a0e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87867cb9c9c24c62973ae02fbcfb9d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:46Z,use_quota=True,user_id='83113b23b7a842b688a9b71ab7b9f2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Creating volume c9b32ef1-28a5-4e00-8594-fcfe046a0e7c {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:51 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:51 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c 1073741824 Apr 07 06:15:51 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:51 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-bf185265-ffe6-41ef-89c0-b8618e36e82c tempest-SnapshotDependencyTests-771360129 None] Create snapshot completed successfully Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "cinder-640f7b31-2adb-4274-826c-037df4adbc1a-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-640f7b31-2adb-4274-826c-037df4adbc1a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "cinder-quobyte-640f7b31-2adb-4274-826c-037df4adbc1a" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-quobyte-640f7b31-2adb-4274-826c-037df4adbc1a" acquired by "delete_volume" :: waited 0.015s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31a6829-caf0-49d0-9c0e-bd685073301f]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-640f7b31-2adb-4274-826c-037df4adbc1a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:51 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-640f7b31-2adb-4274-826c-037df4adbc1a Apr 07 06:15:51 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:51 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c 1073741824" returned: 0 in 0.506s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:51 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c Apr 07 06:15:51 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG oslo_service.periodic_task [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82475) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:51 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:15:51 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:51 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-640f7b31-2adb-4274-826c-037df4adbc1a" returned: 0 in 0.461s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:51 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-640f7b31-2adb-4274-826c-037df4adbc1a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:51 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-640f7b31-2adb-4274-826c-037df4adbc1a Apr 07 06:15:51 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:52 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c" returned: 0 in 0.441s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.418s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1337372793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8010b7b-e7c4-466d-aac3-cb5e8130c8ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb195141ce88476681b719f277244864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:50Z,use_quota=True,user_id='88b9a7381855471f943e6b254cf888cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Creating volume b8010b7b-e7c4-466d-aac3-cb5e8130c8ea {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:52 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b55a83-83cc-4b0a-8c7b-b73c7d1ef665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1281f78-a3c5-4e97-88d1-148480b5b1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:52 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea 1073741824 Apr 07 06:15:52 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Volume volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c (c9b32ef1-28a5-4e00-8594-fcfe046a0e7c): created successfully Apr 07 06:15:52 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1281f78-a3c5-4e97-88d1-148480b5b1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Flow 'volume_create_manager' (9a4882c4-28d6-4fee-8093-c638ec537502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:52 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-6e40d92a-640f-4809-b1b5-37e8e5af387f tempest-VolumeDependencyTests-794886482 None] Created volume successfully. Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Flow 'volume_create_manager' (20901dac-0059-46cc-9920-d3516295ab7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c86360-1c3c-471c-be96-cb2683db70f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c86360-1c3c-471c-be96-cb2683db70f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c28f989-d3f1-4af6-a30c-57888db1faef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582963d90bc24e7e8b292f6cf65453b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d3690a92-6642-4541-9066-290d5489b22d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:52Z,use_quota=True,user_id='dc649b16c4c94ce5a43fa4f9f9b3158b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:52 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c1bc6b8-272d-44d4-b786-a462945729c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c1bc6b8-272d-44d4-b786-a462945729c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdade8c4-c1d3-47c8-bdf6-b2ffb9586437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdade8c4-c1d3-47c8-bdf6-b2ffb9586437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7c28f989-d3f1-4af6-a30c-57888db1faef', 'volume_name': 'volume-7c28f989-d3f1-4af6-a30c-57888db1faef', 'volume_size': 1, 'snapshot_id': 'd3690a92-6642-4541-9066-290d5489b22d'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a04e406-f581-4b4e-b043-2b7770106145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a04e406-f581-4b4e-b043-2b7770106145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68de2e9-22b1-4915-94ce-9a09c7426f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:52 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Volume 7c28f989-d3f1-4af6-a30c-57888db1faef: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7c28f989-d3f1-4af6-a30c-57888db1faef', 'volume_size': 1, 'snapshot_id': 'd3690a92-6642-4541-9066-290d5489b22d'} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-640f7b31-2adb-4274-826c-037df4adbc1a" returned: 0 in 0.468s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-quobyte-640f7b31-2adb-4274-826c-037df4adbc1a" released by "delete_volume" :: held 0.949s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Created reservations ['e7e19791-ee9a-4ae1-955f-a6575befafe0', '3264be9e-84a9-40c3-9fc5-b0552aec3dba', '2b2571a9-f4d0-499d-a4fc-a92207b745f4', 'b7e58700-be28-4640-87e5-2dfab8a24b3d'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:52 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.557s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-38878ced-fa3f-4928-81ee-5d6f2c6d0269 None None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "cinder-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:52 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:15:52 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "cinder-quobyte-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-quobyte-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8" acquired by "delete_volume" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75e1463-3ae3-4d5d-abef-d8e4c431605b]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:52 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8 Apr 07 06:15:52 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:52 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea 1073741824" returned: 0 in 0.631s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:52 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea Apr 07 06:15:52 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Flow 'volume_create_manager' (a38eb269-1d3d-4c92-866d-e32e738d0c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f81e1a7e-1fb8-4a81-a62f-b3b691175359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f81e1a7e-1fb8-4a81-a62f-b3b691175359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2132377292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87867cb9c9c24c62973ae02fbcfb9d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c9b32ef1-28a5-4e00-8594-fcfe046a0e7c,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:53Z,use_quota=True,user_id='83113b23b7a842b688a9b71ab7b9f2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68e1a55-efa0-45db-ae29-ad4561ea7a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68e1a55-efa0-45db-ae29-ad4561ea7a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2feb0ec0-9bf7-4425-8bb1-601bcdfd7a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2feb0ec0-9bf7-4425-8bb1-601bcdfd7a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5', 'volume_name': 'volume-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5', 'volume_size': 1, 'source_volid': 'c9b32ef1-28a5-4e00-8594-fcfe046a0e7c', 'source_volstatus': 'available'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0df56a1-8202-4c35-8e49-e0a579dcf929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0df56a1-8202-4c35-8e49-e0a579dcf929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbe14d4-6df4-49e5-a527-f68ae2021291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:52 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Volume 7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5', 'volume_size': 1, 'source_volid': 'c9b32ef1-28a5-4e00-8594-fcfe046a0e7c', 'source_volstatus': 'available'} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:52 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.534s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:52 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:52 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Deleted volume successfully. Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-fa5a000b-41ce-47bf-aff0-8b7daa7e6f38 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-640f7b31-2adb-4274-826c-037df4adbc1a-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:53 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8" returned: 0 in 0.550s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:53 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8 Apr 07 06:15:53 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:53 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea" returned: 0 in 0.419s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.329s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-289399628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7029c05d-689f-4448-a6f8-8576cb6e143a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb195141ce88476681b719f277244864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:50Z,use_quota=True,user_id='88b9a7381855471f943e6b254cf888cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Creating volume 7029c05d-689f-4448-a6f8-8576cb6e143a {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:53 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7029c05d-689f-4448-a6f8-8576cb6e143a 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4adbc7-1d75-42d9-84a0-3bc4e791d213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:53 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7029c05d-689f-4448-a6f8-8576cb6e143a 1073741824 Apr 07 06:15:53 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48dc897b-88ba-4d1f-b45a-a0059d80e978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:53 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Volume volume-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea (b8010b7b-e7c4-466d-aac3-cb5e8130c8ea): created successfully Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48dc897b-88ba-4d1f-b45a-a0059d80e978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Flow 'volume_create_manager' (a8a193c7-9401-4bda-8dfe-64c85880fdf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:53 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-e452a440-9087-43e4-929e-e281c26f9f7a tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Created volume successfully. Apr 07 06:15:53 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8" returned: 0 in 0.391s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-quobyte-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8" released by "delete_volume" :: held 0.977s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Created reservations ['d26423f9-51e0-46b5-a5ad-723c631374d2', '8d7eaf82-461a-41f5-98db-549c519bbbd3', 'a545e0a8-73ae-4d2b-8485-0b8b51290492', 'b9b0795b-a273-4187-a02f-155d710259ab'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "cinder-3d688154-4dd8-4675-a9ce-7d7694701a30-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:53 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:15:53 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:53 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7029c05d-689f-4448-a6f8-8576cb6e143a 1073741824" returned: 0 in 0.486s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-3d688154-4dd8-4675-a9ce-7d7694701a30-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "cinder-quobyte-3d688154-4dd8-4675-a9ce-7d7694701a30" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7029c05d-689f-4448-a6f8-8576cb6e143a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-quobyte-3d688154-4dd8-4675-a9ce-7d7694701a30" acquired by "delete_volume" :: waited 0.023s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:53 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7029c05d-689f-4448-a6f8-8576cb6e143a Apr 07 06:15:53 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4a170c-ad59-471e-ab7c-367756a8e6d0]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:53 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-3d688154-4dd8-4675-a9ce-7d7694701a30 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:53 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-3d688154-4dd8-4675-a9ce-7d7694701a30 Apr 07 06:15:53 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:54 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.406s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:54 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Deleted volume successfully. Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-23f38b26-a79c-45d0-98e6-b9d8bb068e75 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-66d58e1a-ae4c-48d2-b9d9-2e3565dbe6f8-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:54 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7029c05d-689f-4448-a6f8-8576cb6e143a" returned: 0 in 0.403s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.045s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-817582661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ebb04c-e57c-4875-8379-766fa1d7fcf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb195141ce88476681b719f277244864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:50Z,use_quota=True,user_id='88b9a7381855471f943e6b254cf888cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Creating volume 65ebb04c-e57c-4875-8379-766fa1d7fcf8 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:54 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65ebb04c-e57c-4875-8379-766fa1d7fcf8 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672e6ed4-435c-4036-89d9-e79867131de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7029c05d-689f-4448-a6f8-8576cb6e143a', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:54 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65ebb04c-e57c-4875-8379-766fa1d7fcf8 1073741824 Apr 07 06:15:54 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694a6465-a5d3-4620-b8bf-bd9c4f630282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:54 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Volume volume-7029c05d-689f-4448-a6f8-8576cb6e143a (7029c05d-689f-4448-a6f8-8576cb6e143a): created successfully Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694a6465-a5d3-4620-b8bf-bd9c4f630282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Flow 'volume_create_manager' (c1d754b0-e22c-427c-a6ca-7c44b61bd814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:54 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-28f1743e-7799-4755-acfd-ae5a1e972ecf tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Created volume successfully. Apr 07 06:15:54 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-3d688154-4dd8-4675-a9ce-7d7694701a30" returned: 0 in 0.474s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-3d688154-4dd8-4675-a9ce-7d7694701a30 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:54 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-3d688154-4dd8-4675-a9ce-7d7694701a30 Apr 07 06:15:54 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:54 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65ebb04c-e57c-4875-8379-766fa1d7fcf8 1073741824" returned: 0 in 0.451s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65ebb04c-e57c-4875-8379-766fa1d7fcf8 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:54 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65ebb04c-e57c-4875-8379-766fa1d7fcf8 Apr 07 06:15:54 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:54 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-3d688154-4dd8-4675-a9ce-7d7694701a30" returned: 0 in 0.417s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-quobyte-3d688154-4dd8-4675-a9ce-7d7694701a30" released by "delete_volume" :: held 0.916s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Created reservations ['8eda2b2b-191e-491a-91a0-e7373727542d', 'd225f1b4-579c-4ff6-9533-de7c6661725d', '454d2427-f2b5-453b-b488-653374a16912', 'd155a628-07ad-4131-98de-f9e9b534af20'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:54 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:15:54 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "cinder-c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "cinder-quobyte-233eae86-59a0-4779-b6c2-89d0c21635ee" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-quobyte-233eae86-59a0-4779-b6c2-89d0c21635ee" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "cinder-quobyte-c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-quobyte-c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] Deleting offline snapshot c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a of volume 233eae86-59a0-4779-b6c2-89d0c21635ee {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] snapshot_file for this snap is: volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7c7b21-f544-4ec0-81cb-677be99c762a]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:54 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:54 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a Apr 07 06:15:54 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:55 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65ebb04c-e57c-4875-8379-766fa1d7fcf8" returned: 0 in 0.420s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.712s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1057825845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ef459f-5840-4a15-ae72-8d57370ac0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb195141ce88476681b719f277244864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:50Z,use_quota=True,user_id='88b9a7381855471f943e6b254cf888cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Creating volume 07ef459f-5840-4a15-ae72-8d57370ac0c3 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:55 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-07ef459f-5840-4a15-ae72-8d57370ac0c3 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc3973f-82ea-47b3-aa68-47bffac518bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65ebb04c-e57c-4875-8379-766fa1d7fcf8', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221c7ae4-6cce-41b5-808c-f1bc66c28a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:55 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-07ef459f-5840-4a15-ae72-8d57370ac0c3 1073741824 Apr 07 06:15:55 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:55 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Volume volume-65ebb04c-e57c-4875-8379-766fa1d7fcf8 (65ebb04c-e57c-4875-8379-766fa1d7fcf8): created successfully Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221c7ae4-6cce-41b5-808c-f1bc66c28a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Flow 'volume_create_manager' (6ed44123-a6b0-4c25-a91a-3cf0c3121505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:55 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-77c926ba-85d3-4d73-9efc-a8e7a4cd87a1 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Created volume successfully. Apr 07 06:15:55 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.415s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:55 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Deleted volume successfully. Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-6f38ce43-de39-4818-91dd-33f965db6ef0 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-3d688154-4dd8-4675-a9ce-7d7694701a30-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:55 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a" returned: 0 in 0.473s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-233eae86-59a0-4779-b6c2-89d0c21635ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[9927239a-99be-4a19-95ce-6a8fe4156f96]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:55 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee Apr 07 06:15:55 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:55 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-07ef459f-5840-4a15-ae72-8d57370ac0c3 1073741824" returned: 0 in 0.452s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-07ef459f-5840-4a15-ae72-8d57370ac0c3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:55 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-07ef459f-5840-4a15-ae72-8d57370ac0c3 Apr 07 06:15:55 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:55 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee" returned: 0 in 0.472s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:55 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a Apr 07 06:15:55 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:55 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-07ef459f-5840-4a15-ae72-8d57370ac0c3" returned: 0 in 0.438s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.446s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-60739426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae5786e-4412-4e41-8548-97a4d4d58e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb195141ce88476681b719f277244864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:15:50Z,use_quota=True,user_id='88b9a7381855471f943e6b254cf888cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Creating volume dae5786e-4412-4e41-8548-97a4d4d58e31 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:55 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dae5786e-4412-4e41-8548-97a4d4d58e31 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db24776-dcbd-4e40-a71f-b9476d449abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07ef459f-5840-4a15-ae72-8d57370ac0c3', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:55 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dae5786e-4412-4e41-8548-97a4d4d58e31 1073741824 Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584868c9-3099-40fc-a022-8b9e5355e272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:55 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:55 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Volume volume-07ef459f-5840-4a15-ae72-8d57370ac0c3 (07ef459f-5840-4a15-ae72-8d57370ac0c3): created successfully Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584868c9-3099-40fc-a022-8b9e5355e272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:55 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Flow 'volume_create_manager' (678642d4-8f0d-4291-b10e-005fa7c13ff0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:56 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-95e54a3d-4626-43ab-8020-355dff962641 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Created volume successfully. Apr 07 06:15:56 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a" returned: 0 in 0.437s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:56 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a Apr 07 06:15:56 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:56 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dae5786e-4412-4e41-8548-97a4d4d58e31 1073741824" returned: 0 in 0.458s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dae5786e-4412-4e41-8548-97a4d4d58e31 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:56 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dae5786e-4412-4e41-8548-97a4d4d58e31 Apr 07 06:15:56 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:56 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee.c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a" returned: 0 in 0.414s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-quobyte-c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a" released by "_delete_snapshot" :: held 1.851s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-quobyte-233eae86-59a0-4779-b6c2-89d0c21635ee" released by "delete_snapshot" :: held 1.865s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] Created reservations ['22a2962b-1af3-42c5-a186-ffdcf2cd1fbb', '864a4df5-4840-4c93-8bfd-f7a0f3f1dcb9', '0b58ccc5-d96a-4dc8-9526-c8d8ea99975f', '57ad0aa4-d271-4897-8bb5-ae5019b68988'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:56 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] Delete snapshot completed successfully. Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c807baf5-bde6-4af4-bda6-0f06ddc0522b tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-c1b66f3e-35e2-4263-95f7-fa8ec8c0cc4a-delete_snapshot" released by "delete_snapshot" :: held 1.957s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:56 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dae5786e-4412-4e41-8548-97a4d4d58e31" returned: 0 in 0.403s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.528s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Acquiring lock "cinder-quobyte-d3690a92-6642-4541-9066-290d5489b22d-7c28f989-d3f1-4af6-a30c-57888db1faef" by "_create_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd39a44d-0b02-4a9f-b737-b81e2fb1dc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dae5786e-4412-4e41-8548-97a4d4d58e31', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c752e7de-04d2-4271-a9c9-8295171925ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Lock "cinder-quobyte-d3690a92-6642-4541-9066-290d5489b22d-7c28f989-d3f1-4af6-a30c-57888db1faef" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Creating volume 7c28f989-d3f1-4af6-a30c-57888db1faef from snapshot d3690a92-6642-4541-9066-290d5489b22d {{(pid=82475) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Acquiring lock "cinder-quobyte-7c28f989-d3f1-4af6-a30c-57888db1faef" by "_copy_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:56 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Volume volume-dae5786e-4412-4e41-8548-97a4d4d58e31 (dae5786e-4412-4e41-8548-97a4d4d58e31): created successfully Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c752e7de-04d2-4271-a9c9-8295171925ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Flow 'volume_create_manager' (5b3fdf20-b3af-4e13-a6e1-882c6e33ba9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "cinder-233eae86-59a0-4779-b6c2-89d0c21635ee-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:56 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-bab5c4d6-887b-4b3a-9019-1894d3b36d3e tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Created volume successfully. Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Lock "cinder-quobyte-7c28f989-d3f1-4af6-a30c-57888db1faef" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] snapshot: d3690a92-6642-4541-9066-290d5489b22d, volume: 7c28f989-d3f1-4af6-a30c-57888db1faef, {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-233eae86-59a0-4779-b6c2-89d0c21635ee-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[a934c129-0f19-41b6-a9f9-7be878725b1f]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:56 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "cinder-quobyte-233eae86-59a0-4779-b6c2-89d0c21635ee" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-quobyte-233eae86-59a0-4779-b6c2-89d0c21635ee" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:57 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d0c99b-8826-48a8-a528-fc4ffbfe575f]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:57 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d Apr 07 06:15:57 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:57 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee Apr 07 06:15:57 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:57 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d" returned: 0 in 0.446s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d252bf79-b606-485a-9135-3469249c025d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:15:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] will copy from snapshot at /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:15:57 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Creating direct copy from snapshot {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:15:57 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4ba621-bc91-422c-bb71-d875f36fee0d]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:57 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee" returned: 0 in 0.459s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:57 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee Apr 07 06:15:57 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:57 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d Apr 07 06:15:57 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:57 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d" returned: 0 in 0.438s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:57 devstack cinder-volume[82475]: DEBUG cinder.utils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Path /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7c28f989-d3f1-4af6-a30c-57888db1faef not found in is_blk_device check {{(pid=82475) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:15:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7c28f989-d3f1-4af6-a30c-57888db1faef {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:57 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:57 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-233eae86-59a0-4779-b6c2-89d0c21635ee" returned: 0 in 0.404s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:57 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7c28f989-d3f1-4af6-a30c-57888db1faef Apr 07 06:15:57 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:57 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-quobyte-233eae86-59a0-4779-b6c2-89d0c21635ee" released by "delete_volume" :: held 0.890s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:57 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Created reservations ['bec63c11-a0da-4e88-9d58-7a21506fc631', 'c48fe51b-6041-49bc-9efc-e8e12b31536e', '7bf9b4e7-ec30-438c-81d4-a68f16c368de', '136569cf-2e0f-46e1-90a5-c42509202582'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:15:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:15:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:15:58 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:15:58 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:15:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:15:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:58 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "cinder-dae5786e-4412-4e41-8548-97a4d4d58e31-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:58 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-dae5786e-4412-4e41-8548-97a4d4d58e31-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:58 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:15:58 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:58 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "cinder-quobyte-dae5786e-4412-4e41-8548-97a4d4d58e31" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:15:58 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-quobyte-dae5786e-4412-4e41-8548-97a4d4d58e31" acquired by "delete_volume" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:15:58 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[611a111c-7fd5-4de0-8efb-78027752e5de]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:15:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dae5786e-4412-4e41-8548-97a4d4d58e31 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:58 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dae5786e-4412-4e41-8548-97a4d4d58e31 Apr 07 06:15:58 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:15:58 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:58 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.973s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:58 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:15:58 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Deleted volume successfully. Apr 07 06:15:59 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65b128e1-dd1f-4eef-aa85-854cfee9ccd8 tempest-CreateVolumesFromSnapshotTest-2096536899 None] Lock "cinder-233eae86-59a0-4779-b6c2-89d0c21635ee-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:15:59 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Apr 07 06:15:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dae5786e-4412-4e41-8548-97a4d4d58e31" returned: 0 in 1.052s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:15:59 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dae5786e-4412-4e41-8548-97a4d4d58e31 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:15:59 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dae5786e-4412-4e41-8548-97a4d4d58e31 Apr 07 06:15:59 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:00 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7c28f989-d3f1-4af6-a30c-57888db1faef" returned: 0 in 2.276s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:00 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c033628-83ea-4cc3-a0f3-522ca884eb54]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:00 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-dae5786e-4412-4e41-8548-97a4d4d58e31" returned: 0 in 1.035s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:00 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-quobyte-dae5786e-4412-4e41-8548-97a4d4d58e31" released by "delete_volume" :: held 2.116s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:00 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Created reservations ['bf488054-a982-4efd-aefb-b85e181c4ce1', 'e1fc1af5-d8c8-4509-8b3e-94f8258db8cb', 'c31873b2-4ae2-469a-9edd-5480d3639ffe', 'dbaa2325-e67f-40ef-8d40-49e7d84b4ac0'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:00 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d Apr 07 06:16:00 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:00 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:00 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:00 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:16:00 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:00 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.449s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:00 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:00 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Deleted volume successfully. Apr 07 06:16:00 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-77c2ca52-b7cd-4bda-8472-77df62908362 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-dae5786e-4412-4e41-8548-97a4d4d58e31-delete_volume" released by "delete_volume" :: held 2.720s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:00 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d" returned: 0 in 0.685s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:00 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Image conversion details: src /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d, size 1024.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7c28f989-d3f1-4af6-a30c-57888db1faef {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:16:00 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Converted 1024.00 MB image at 449.65 MB/s Apr 07 06:16:00 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7c28f989-d3f1-4af6-a30c-57888db1faef is being set with open permissions: ugo+rw Apr 07 06:16:00 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7c28f989-d3f1-4af6-a30c-57888db1faef {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:00 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7c28f989-d3f1-4af6-a30c-57888db1faef Apr 07 06:16:00 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Flow 'volume_create_manager' (222e82af-6a20-4e65-91f0-403f9fbac023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfd825e-f95d-443c-bf7a-c6b56ce2bf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfd825e-f95d-443c-bf7a-c6b56ce2bf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb089ee1-8873-4e52-af11-55a6fd74ddac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2eb33f2865a46f292f45022d3c8ed72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:16:01Z,use_quota=True,user_id='4b5239fc5a4c4bc3808e6d8ded22c66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06f3599-5736-41af-b3a7-5d4d894fb755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06f3599-5736-41af-b3a7-5d4d894fb755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f9ae55-1d5d-4155-b472-12159155716a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f9ae55-1d5d-4155-b472-12159155716a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb089ee1-8873-4e52-af11-55a6fd74ddac', 'volume_name': 'volume-cb089ee1-8873-4e52-af11-55a6fd74ddac', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79d33ee-baac-434f-a9f0-ceee267b4147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79d33ee-baac-434f-a9f0-ceee267b4147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87c7d3d-3a04-42ba-a3d7-9c266423dc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:01 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Volume cb089ee1-8873-4e52-af11-55a6fd74ddac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb089ee1-8873-4e52-af11-55a6fd74ddac', 'volume_size': 1} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:01 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7c28f989-d3f1-4af6-a30c-57888db1faef" returned: 0 in 0.394s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Lock "cinder-quobyte-7c28f989-d3f1-4af6-a30c-57888db1faef" released by "_copy_volume_from_snapshot" :: held 4.310s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Lock "cinder-quobyte-d3690a92-6642-4541-9066-290d5489b22d-7c28f989-d3f1-4af6-a30c-57888db1faef" released by "_create_volume_from_snapshot" :: held 4.373s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.401s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.347s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:01 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Cloning volume c9b32ef1-28a5-4e00-8594-fcfe046a0e7c to volume 7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5 Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Creating offline snapshot 2aa056aa-bcc4-4fdb-8f77-ce5d62144d76 of volume c9b32ef1-28a5-4e00-8594-fcfe046a0e7c {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68de2e9-22b1-4915-94ce-9a09c7426f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c28f989-d3f1-4af6-a30c-57888db1faef', 'volume_size': 1, 'snapshot_id': 'd3690a92-6642-4541-9066-290d5489b22d'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3a11c3-856c-4da7-a937-05087118df08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[d078c5e8-dfc6-48a8-90dc-a8e4aa7aa7d0]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:01 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Volume volume-7c28f989-d3f1-4af6-a30c-57888db1faef (7c28f989-d3f1-4af6-a30c-57888db1faef): created successfully Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3a11c3-856c-4da7-a937-05087118df08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Flow 'volume_create_manager' (20901dac-0059-46cc-9920-d3516295ab7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "cinder-07ef459f-5840-4a15-ae72-8d57370ac0c3-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:01 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-87757439-62df-470d-9949-30d7f17935b7 tempest-SnapshotDependencyTests-771360129 None] Created volume successfully. Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-07ef459f-5840-4a15-ae72-8d57370ac0c3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:01 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c Apr 07 06:16:01 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "cinder-quobyte-07ef459f-5840-4a15-ae72-8d57370ac0c3" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-quobyte-07ef459f-5840-4a15-ae72-8d57370ac0c3" acquired by "delete_volume" :: waited 0.006s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2caa6e-3e43-42ae-9ad3-5a5997ccbb31]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-07ef459f-5840-4a15-ae72-8d57370ac0c3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:01 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-07ef459f-5840-4a15-ae72-8d57370ac0c3 Apr 07 06:16:01 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:01 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c" returned: 0 in 0.453s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:01 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76 1G Apr 07 06:16:01 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:01 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-07ef459f-5840-4a15-ae72-8d57370ac0c3" returned: 0 in 0.476s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:01 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-07ef459f-5840-4a15-ae72-8d57370ac0c3 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:01 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-07ef459f-5840-4a15-ae72-8d57370ac0c3 Apr 07 06:16:01 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] Acquiring lock "cinder-d3690a92-6642-4541-9066-290d5489b22d-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] Lock "cinder-d3690a92-6642-4541-9066-290d5489b22d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] Acquiring lock "cinder-quobyte-d252bf79-b606-485a-9135-3469249c025d" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] Lock "cinder-quobyte-d252bf79-b606-485a-9135-3469249c025d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] Acquiring lock "cinder-quobyte-d3690a92-6642-4541-9066-290d5489b22d" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] Lock "cinder-quobyte-d3690a92-6642-4541-9066-290d5489b22d" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] Deleting offline snapshot d3690a92-6642-4541-9066-290d5489b22d of volume d252bf79-b606-485a-9135-3469249c025d {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] snapshot_file for this snap is: volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9bf127-37f2-4b77-8a24-56766c830889]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:02 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d Apr 07 06:16:02 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:02 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76 1G" returned: 0 in 0.552s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:02 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76 Apr 07 06:16:02 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:02 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-07ef459f-5840-4a15-ae72-8d57370ac0c3" returned: 0 in 0.477s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-quobyte-07ef459f-5840-4a15-ae72-8d57370ac0c3" released by "delete_volume" :: held 0.975s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Created reservations ['541e9976-d046-4a64-9c5e-c726f9eb0612', 'aea179c5-3075-4266-8b65-a9cf6ce1a9e4', '5df9b983-8a66-4994-8ba3-8321828d884f', '6f0a7e8d-6f29-4dc3-bdcc-03883c8369eb'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:02 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:16:02 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:02 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d" returned: 0 in 0.511s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d252bf79-b606-485a-9135-3469249c025d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39c856a-2515-4308-89fb-493dfc48cbc4]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:02 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d Apr 07 06:16:02 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:02 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76" returned: 0 in 0.428s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:02 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76 is being set with open permissions: ugo+rw Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:02 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76 Apr 07 06:16:02 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:02 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.411s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:02 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Deleted volume successfully. Apr 07 06:16:02 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-65c37fb4-d279-4080-806f-53a24957d703 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-07ef459f-5840-4a15-ae72-8d57370ac0c3-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:03 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d" returned: 0 in 0.486s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:03 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d Apr 07 06:16:03 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:03 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76" returned: 0 in 0.415s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:03 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.info Apr 07 06:16:03 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "cinder-65ebb04c-e57c-4875-8379-766fa1d7fcf8-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-65ebb04c-e57c-4875-8379-766fa1d7fcf8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "cinder-quobyte-65ebb04c-e57c-4875-8379-766fa1d7fcf8" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:03 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-quobyte-65ebb04c-e57c-4875-8379-766fa1d7fcf8" acquired by "delete_volume" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:03 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ad8aab-7b1e-4dca-a08c-c6997c2e8841]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65ebb04c-e57c-4875-8379-766fa1d7fcf8 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:03 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d" returned: 0 in 0.475s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:03 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d Apr 07 06:16:03 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:03 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65ebb04c-e57c-4875-8379-766fa1d7fcf8 Apr 07 06:16:03 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:03 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.info" returned: 0 in 0.454s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:03 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.info is being set with open permissions: ugo+rw Apr 07 06:16:03 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:03 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.info Apr 07 06:16:03 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:04 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d.d3690a92-6642-4541-9066-290d5489b22d" returned: 0 in 0.403s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:04 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:04 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65ebb04c-e57c-4875-8379-766fa1d7fcf8" returned: 0 in 0.464s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65ebb04c-e57c-4875-8379-766fa1d7fcf8 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] Lock "cinder-quobyte-d3690a92-6642-4541-9066-290d5489b22d" released by "_delete_snapshot" :: held 1.953s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.info" returned: 0 in 0.402s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:04 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65ebb04c-e57c-4875-8379-766fa1d7fcf8 Apr 07 06:16:04 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Acquiring lock "cinder-quobyte-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5" by "_copy_volume_from_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] Lock "cinder-quobyte-d252bf79-b606-485a-9135-3469249c025d" released by "delete_snapshot" :: held 1.976s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] snapshot: 2aa056aa-bcc4-4fdb-8f77-ce5d62144d76, volume: 7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5, {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] Created reservations ['6739b112-968c-4a3c-b50c-fdbad0e5f391', '7daa1d07-8a8f-469f-bb21-8d12093569e9', '6fabbe65-d3d5-4181-93f9-aa151b6cd7db', 'da8d5177-91c9-45ab-8127-7e7b1f932d06'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad109f3-d75e-4b25-91be-9a99208972f9]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:04 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] Delete snapshot completed successfully. Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d5cad6a4-89be-42f1-8bcf-95c8d7bbd7a7 tempest-SnapshotDependencyTests-771360129 None] Lock "cinder-d3690a92-6642-4541-9066-290d5489b22d-delete_snapshot" released by "delete_snapshot" :: held 2.105s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:04 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76 Apr 07 06:16:04 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:04 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-65ebb04c-e57c-4875-8379-766fa1d7fcf8" returned: 0 in 0.428s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-quobyte-65ebb04c-e57c-4875-8379-766fa1d7fcf8" released by "delete_volume" :: held 0.911s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Created reservations ['81295ffb-2361-4519-9eec-2c81c601c9ef', 'eed6452a-8915-44fd-9d54-feb62641e5e7', '8803678b-27b4-4b53-a671-01af081505d4', 'c6c4a61b-a3fa-44b8-9a32-84f1516c96ea'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:04 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:16:04 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:04 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76" returned: 0 in 0.488s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] will copy from snapshot at /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Creating direct copy from snapshot {{(pid=82475) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa6b2ac-abd5-4a62-b0a4-81681a501cb1]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "cinder-7029c05d-689f-4448-a6f8-8576cb6e143a-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-7029c05d-689f-4448-a6f8-8576cb6e143a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "cinder-quobyte-7029c05d-689f-4448-a6f8-8576cb6e143a" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-quobyte-7029c05d-689f-4448-a6f8-8576cb6e143a" acquired by "delete_volume" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:04 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c Apr 07 06:16:04 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93b880b-5998-4169-9af2-83d5da1f408e]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:04 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7029c05d-689f-4448-a6f8-8576cb6e143a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:04 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7029c05d-689f-4448-a6f8-8576cb6e143a Apr 07 06:16:04 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:05 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.435s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:05 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Deleted volume successfully. Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3f7af2f6-a1fa-4778-87ca-22189f437fbd tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-65ebb04c-e57c-4875-8379-766fa1d7fcf8-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:05 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c" returned: 0 in 0.458s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG cinder.utils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Path /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5 not found in is_blk_device check {{(pid=82475) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:05 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5 Apr 07 06:16:05 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:05 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7029c05d-689f-4448-a6f8-8576cb6e143a" returned: 0 in 0.463s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7029c05d-689f-4448-a6f8-8576cb6e143a {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:05 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7029c05d-689f-4448-a6f8-8576cb6e143a Apr 07 06:16:05 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] Acquiring lock "cinder-d252bf79-b606-485a-9135-3469249c025d-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] Lock "cinder-d252bf79-b606-485a-9135-3469249c025d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] Acquiring lock "cinder-quobyte-d252bf79-b606-485a-9135-3469249c025d" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] Lock "cinder-quobyte-d252bf79-b606-485a-9135-3469249c025d" acquired by "delete_volume" :: waited 0.020s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a95515-cf88-4e66-a1a8-8e4eb7ebd359]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:05 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d Apr 07 06:16:05 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:05 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7029c05d-689f-4448-a6f8-8576cb6e143a" returned: 0 in 0.541s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-quobyte-7029c05d-689f-4448-a6f8-8576cb6e143a" released by "delete_volume" :: held 1.029s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Created reservations ['c0ad54fa-a36d-4be6-ad10-fa37edf1138e', '70706826-bdca-48fd-9162-7fe0bc5a9c27', '8c6d3a4f-6b9c-4846-8511-2f3461140c40', 'c5a40f11-d9e0-4d2a-bd16-3ef1630f6a8f'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:05 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:06 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:16:06 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:06 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d" returned: 0 in 0.816s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:06 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d Apr 07 06:16:06 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:06 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:06 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-d252bf79-b606-485a-9135-3469249c025d" returned: 0 in 0.821s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:06 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] Lock "cinder-quobyte-d252bf79-b606-485a-9135-3469249c025d" released by "delete_volume" :: held 1.690s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] Created reservations ['a6f897e3-1571-40ee-9019-e8a5c62ac67f', '0fbc4215-e510-44e0-9af9-85a5b327dcfb', '8b39a4f5-2091-480f-abdd-54123772285a', 'd13b8121-c129-4c05-a504-effdba7d4f20'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "cinder-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:07 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 1.130s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:07 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Deleted volume successfully. Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-084f2950-6efd-4bda-a994-65d972792feb tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-7029c05d-689f-4448-a6f8-8576cb6e143a-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "cinder-quobyte-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-quobyte-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea" acquired by "delete_volume" :: waited 0.020s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:07 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:16:07 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59289f5-9da0-4c68-935d-fd47aa465bca]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:07 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5" returned: 0 in 2.151s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a9e969-ab6b-4c03-bf22-a6ebc6742dca]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:07 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea Apr 07 06:16:07 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:07 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c Apr 07 06:16:07 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] Acquiring lock "cinder-7c28f989-d3f1-4af6-a30c-57888db1faef-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] Lock "cinder-7c28f989-d3f1-4af6-a30c-57888db1faef-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] Acquiring lock "cinder-quobyte-7c28f989-d3f1-4af6-a30c-57888db1faef" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] Lock "cinder-quobyte-7c28f989-d3f1-4af6-a30c-57888db1faef" acquired by "delete_volume" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[36311eaf-9352-4133-9670-e33703de3a1c]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7c28f989-d3f1-4af6-a30c-57888db1faef {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:07 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.419s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:07 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] Deleted volume successfully. Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-441916ab-13a6-43b4-adac-b76380441d22 tempest-SnapshotDependencyTests-771360129 None] Lock "cinder-d252bf79-b606-485a-9135-3469249c025d-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:07 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7c28f989-d3f1-4af6-a30c-57888db1faef Apr 07 06:16:07 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:07 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea" returned: 0 in 0.489s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:07 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea Apr 07 06:16:07 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:07 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c" returned: 0 in 0.636s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG cinder.image.image_utils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Image conversion details: src /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5 {{(pid=82475) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 07 06:16:07 devstack cinder-volume[82475]: INFO cinder.image.image_utils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Converted 1024.00 MB image at 475.63 MB/s Apr 07 06:16:07 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5 is being set with open permissions: ugo+rw Apr 07 06:16:07 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:07 devstack sudo[90580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5 Apr 07 06:16:07 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:08 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7c28f989-d3f1-4af6-a30c-57888db1faef" returned: 0 in 0.467s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7c28f989-d3f1-4af6-a30c-57888db1faef {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:08 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7c28f989-d3f1-4af6-a30c-57888db1faef Apr 07 06:16:08 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:08 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea" returned: 0 in 0.395s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-quobyte-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea" released by "delete_volume" :: held 0.904s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Created reservations ['335dc078-e5b5-4769-a5fa-3dfca116f3c5', '60a0bef2-e4b1-44ab-9820-889cbbaf130b', 'a09a93de-bc5d-4e04-92dd-dbd3f985d7ac', 'c742ba19-9e52-49f9-b0a4-18a1fef7c11f'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:08 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:16:08 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "cinder-0bb06065-269f-46e8-b4c7-fc158ebd9e6b-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-0bb06065-269f-46e8-b4c7-fc158ebd9e6b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:08 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "cinder-quobyte-0bb06065-269f-46e8-b4c7-fc158ebd9e6b" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5" returned: 0 in 0.395s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5" released by "_copy_volume_from_snapshot" :: held 4.200s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-quobyte-0bb06065-269f-46e8-b4c7-fc158ebd9e6b" acquired by "delete_volume" :: waited 0.026s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Acquiring lock "cinder-quobyte-2aa056aa-bcc4-4fdb-8f77-ce5d62144d76" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f80b0d-c930-4274-943b-7672b821110f]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0bb06065-269f-46e8-b4c7-fc158ebd9e6b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-2aa056aa-bcc4-4fdb-8f77-ce5d62144d76" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Deleting offline snapshot 2aa056aa-bcc4-4fdb-8f77-ce5d62144d76 of volume c9b32ef1-28a5-4e00-8594-fcfe046a0e7c {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] snapshot_file for this snap is: volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee8c27a-a977-4a7f-bc69-ab9b7ecf85de]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:08 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0bb06065-269f-46e8-b4c7-fc158ebd9e6b Apr 07 06:16:08 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:08 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76 Apr 07 06:16:08 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:08 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7c28f989-d3f1-4af6-a30c-57888db1faef" returned: 0 in 0.452s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] Lock "cinder-quobyte-7c28f989-d3f1-4af6-a30c-57888db1faef" released by "delete_volume" :: held 0.960s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] Created reservations ['7e3c30f8-ea88-4464-8b74-eb24838e2d4d', 'c5f2ba3b-6d99-44c2-8643-92776dfc8293', '2055ddb7-88e1-43c8-a1b1-d8ca3933c51b', '275df4aa-34be-4713-bba3-db923c42f894'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:08 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:16:08 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:08 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.560s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:08 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Deleted volume successfully. Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-916f96db-6d31-49f8-be06-9f950f4b99a0 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-b8010b7b-e7c4-466d-aac3-cb5e8130c8ea-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:08 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76" returned: 0 in 0.523s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3ff803-8a89-4552-bb81-0130cceaa1cd]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:08 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0bb06065-269f-46e8-b4c7-fc158ebd9e6b" returned: 0 in 0.581s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:08 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0bb06065-269f-46e8-b4c7-fc158ebd9e6b {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:08 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0bb06065-269f-46e8-b4c7-fc158ebd9e6b Apr 07 06:16:08 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:08 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c Apr 07 06:16:08 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:09 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.464s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:09 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:09 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] Deleted volume successfully. Apr 07 06:16:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3c5dcfb4-2ad7-47b2-b51f-cd035b184240 tempest-SnapshotDependencyTests-771360129 None] Lock "cinder-7c28f989-d3f1-4af6-a30c-57888db1faef-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:09 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c" returned: 0 in 0.485s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:09 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-0bb06065-269f-46e8-b4c7-fc158ebd9e6b" returned: 0 in 0.478s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:09 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76 Apr 07 06:16:09 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-quobyte-0bb06065-269f-46e8-b4c7-fc158ebd9e6b" released by "delete_volume" :: held 1.083s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:09 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Created reservations ['32f7ba0f-696a-4751-99b6-3eff4081e03a', '9c9d0883-338c-4afe-ba4b-2b2c04bce0e5', 'ad4acfbe-be48-4f17-bfde-b5ec53b000ac', '61aa6c09-1b51-4692-b4d3-e1be680604d3'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:09 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:09 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:16:09 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:09 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76" returned: 0 in 0.463s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:09 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76 Apr 07 06:16:09 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:09 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:09 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.453s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:09 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:09 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Deleted volume successfully. Apr 07 06:16:09 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-1d810ec4-b8a4-4043-94f8-4efc68cc5c84 tempest-CreateVolumesFromSourceVolumeTest-963353968 None] Lock "cinder-0bb06065-269f-46e8-b4c7-fc158ebd9e6b-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:10 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c.2aa056aa-bcc4-4fdb-8f77-ce5d62144d76" returned: 0 in 0.390s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-2aa056aa-bcc4-4fdb-8f77-ce5d62144d76" released by "_delete_snapshot" :: held 1.901s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.976s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.088s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb089ee1-8873-4e52-af11-55a6fd74ddac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2eb33f2865a46f292f45022d3c8ed72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:16:01Z,use_quota=True,user_id='4b5239fc5a4c4bc3808e6d8ded22c66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Creating volume cb089ee1-8873-4e52-af11-55a6fd74ddac {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:16:10 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cb089ee1-8873-4e52-af11-55a6fd74ddac 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:10 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cb089ee1-8873-4e52-af11-55a6fd74ddac 1073741824 Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbe14d4-6df4-49e5-a527-f68ae2021291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5', 'volume_size': 1, 'source_volid': 'c9b32ef1-28a5-4e00-8594-fcfe046a0e7c', 'source_volstatus': 'available'}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:10 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da42f584-0f4e-4806-9827-d6586316b743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:10 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Volume volume-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5 (7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5): created successfully Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da42f584-0f4e-4806-9827-d6586316b743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Flow 'volume_create_manager' (a38eb269-1d3d-4c92-866d-e32e738d0c8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:16:10 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-eb22b2c8-cda2-453b-8f1e-109da229f03e tempest-VolumeDependencyTests-794886482 None] Created volume successfully. Apr 07 06:16:10 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cb089ee1-8873-4e52-af11-55a6fd74ddac 1073741824" returned: 0 in 0.603s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cb089ee1-8873-4e52-af11-55a6fd74ddac {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:10 devstack sudo[90632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cb089ee1-8873-4e52-af11-55a6fd74ddac Apr 07 06:16:10 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] Acquiring lock "cinder-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] Lock "cinder-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:10 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] Acquiring lock "cinder-quobyte-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:11 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c" acquired by "delete_volume" :: waited 0.006s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:11 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4467dac-4495-4712-88d5-8f9163d0091a]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:11 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c Apr 07 06:16:11 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:11 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cb089ee1-8873-4e52-af11-55a6fd74ddac" returned: 0 in 0.607s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:11 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:16:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87c7d3d-3a04-42ba-a3d7-9c266423dc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb089ee1-8873-4e52-af11-55a6fd74ddac', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7bc8f0-1c3e-40a1-858d-89f5d5a11fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:11 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Volume volume-cb089ee1-8873-4e52-af11-55a6fd74ddac (cb089ee1-8873-4e52-af11-55a6fd74ddac): created successfully Apr 07 06:16:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7bc8f0-1c3e-40a1-858d-89f5d5a11fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:11 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Flow 'volume_create_manager' (222e82af-6a20-4e65-91f0-403f9fbac023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:16:11 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-0f116ec4-a598-409c-bd12-896f681bdee8 tempest-CinderUnicodeTest-478200254 None] Created volume successfully. Apr 07 06:16:11 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c" returned: 0 in 0.630s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:11 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:11 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c Apr 07 06:16:11 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.volume.flows.manager.create_volume [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82475) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Flow 'volume_create_manager' (abfb3900-c9c7-4156-bc05-a2dac603bd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1585c956-f387-4f65-83e2-72c3ccfd44d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1585c956-f387-4f65-83e2-72c3ccfd44d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:16:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2087204316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a3ea6a-6da2-4f1a-8af3-23d526822bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2eb33f2865a46f292f45022d3c8ed72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:16:12Z,use_quota=True,user_id='4b5239fc5a4c4bc3808e6d8ded22c66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1baafef6-5847-4549-9320-32c507d66ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1baafef6-5847-4549-9320-32c507d66ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac28a58-29c1-4ad1-992e-2709c22da042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac28a58-29c1-4ad1-992e-2709c22da042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48a3ea6a-6da2-4f1a-8af3-23d526822bd2', 'volume_name': 'volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c92f79ff-22d9-46dc-b778-593218fde78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c92f79ff-22d9-46dc-b778-593218fde78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517e1124-c110-43b6-b95c-0aa32eb87978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:12 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Volume 48a3ea6a-6da2-4f1a-8af3-23d526822bd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2', 'volume_size': 1} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-07T04:16:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2087204316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a3ea6a-6da2-4f1a-8af3-23d526822bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2eb33f2865a46f292f45022d3c8ed72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-07T04:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-07T04:16:12Z,use_quota=True,user_id='4b5239fc5a4c4bc3808e6d8ded22c66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c3da71-3741-487c-993a-cea9452e311f),volume_type_id=37c3da71-3741-487c-993a-cea9452e311f)}" {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Creating volume 48a3ea6a-6da2-4f1a-8af3-23d526822bd2 {{(pid=82475) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Selected osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 as target Quobyte volume. {{(pid=82475) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 07 06:16:12 devstack cinder-volume[82475]: INFO cinder.volume.drivers.remotefs [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] casted to osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7 Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2 1073741824 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:12 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c" returned: 0 in 0.487s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:12 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2 1073741824 Apr 07 06:16:12 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c" released by "delete_volume" :: held 1.144s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] Created reservations ['0b0dec14-febf-442b-addf-f0bdafce991f', '63aaeb65-6b2b-44df-b045-49c787846643', '4bb62535-ef8d-4963-8158-e0084b9794f1', '929e31d3-885b-4fc7-bc89-95848c46f7f3'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:12 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:16:12 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:12 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.423s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:12 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] Deleted volume successfully. Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-d7a9c948-6f4d-4cb3-955d-9bfcfe2cbcbf tempest-VolumeDependencyTests-794886482 None] Lock "cinder-c9b32ef1-28a5-4e00-8594-fcfe046a0e7c-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:12 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2 1073741824" returned: 0 in 0.551s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:12 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:12 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2 Apr 07 06:16:12 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:13 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2" returned: 0 in 0.451s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:13 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'} {{(pid=82475) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 07 06:16:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] Acquiring lock "cinder-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:13 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517e1124-c110-43b6-b95c-0aa32eb87978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2', 'volume_size': 1}' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:13 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76314899-7eb9-4cf2-8593-9caf1e78e594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 07 06:16:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] Lock "cinder-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:13 devstack cinder-volume[82475]: INFO cinder.volume.flows.manager.create_volume [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Volume volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2 (48a3ea6a-6da2-4f1a-8af3-23d526822bd2): created successfully Apr 07 06:16:13 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76314899-7eb9-4cf2-8593-9caf1e78e594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82475) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 07 06:16:13 devstack cinder-volume[82475]: DEBUG cinder.volume.manager [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Flow 'volume_create_manager' (abfb3900-c9c7-4156-bc05-a2dac603bd0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82475) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 07 06:16:13 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-e087d5dd-6bd1-462e-a1fc-1b1cb6308631 tempest-CinderUnicodeTest-478200254 None] Created volume successfully. Apr 07 06:16:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] Acquiring lock "cinder-quobyte-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:13 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5" acquired by "delete_volume" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:13 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff119fd-6ed7-40eb-8d9d-d57f36b064a4]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:13 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5 Apr 07 06:16:13 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:13 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5" returned: 0 in 0.465s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:13 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:13 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5 Apr 07 06:16:13 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:14 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5" returned: 0 in 0.409s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5" released by "delete_volume" :: held 0.897s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] Created reservations ['194dddc2-dbe7-4710-a901-da2c4f45baac', 'b7a6148b-eb88-4be8-a66b-55194f2e6054', 'e33f0352-e620-44c0-8255-855483f89da9', '931c735e-7591-4e65-99c0-4a8f7397a086'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:14 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:16:14 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] Acquiring lock "cinder-a04599da-7d09-49f3-b068-483aac83ae0f-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:INSERT=69,cinder:UPDATE=271,cinder:SELECT=185,cinder:DELETE=28 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-01ac85ec-9bc9-4c44-9201-badd51d6f4f4 tempest-CinderUnicodeTest-478200254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-01ac85ec-9bc9-4c44-9201-badd51d6f4f4 tempest-CinderUnicodeTest-478200254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] Lock "cinder-a04599da-7d09-49f3-b068-483aac83ae0f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:SELECT=205,cinder:INSERT=63,cinder:UPDATE=288,cinder:DELETE=22 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-01ac85ec-9bc9-4c44-9201-badd51d6f4f4 tempest-CinderUnicodeTest-478200254 None] Creating offline snapshot 21b5921d-78fa-453a-a0c3-01841bb32450 of volume 48a3ea6a-6da2-4f1a-8af3-23d526822bd2 {{(pid=82475) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[7987cdb9-0944-4e2b-aa1b-f0d83b3200e4]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-01ac85ec-9bc9-4c44-9201-badd51d6f4f4 tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] Acquiring lock "cinder-quobyte-a04599da-7d09-49f3-b068-483aac83ae0f" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-a04599da-7d09-49f3-b068-483aac83ae0f" acquired by "delete_volume" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[043862a1-4e27-4572-8799-d51c259cab9b]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a04599da-7d09-49f3-b068-483aac83ae0f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:14 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2 Apr 07 06:16:14 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:14 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a04599da-7d09-49f3-b068-483aac83ae0f Apr 07 06:16:14 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:14 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.496s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:14 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] Deleted volume successfully. Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-272a37fd-04b5-482f-9bf7-a5427578ffab tempest-VolumeDependencyTests-794886482 None] Lock "cinder-7a31aad9-132c-4b0e-a2b2-3cddcdc0d5b5-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:14 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-01ac85ec-9bc9-4c44-9201-badd51d6f4f4 tempest-CinderUnicodeTest-478200254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2" returned: 0 in 0.561s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:14 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-01ac85ec-9bc9-4c44-9201-badd51d6f4f4 tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450 1G {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:14 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450 1G Apr 07 06:16:14 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:15 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a04599da-7d09-49f3-b068-483aac83ae0f" returned: 0 in 0.574s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a04599da-7d09-49f3-b068-483aac83ae0f {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:15 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a04599da-7d09-49f3-b068-483aac83ae0f Apr 07 06:16:15 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:15 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-a04599da-7d09-49f3-b068-483aac83ae0f" returned: 0 in 0.388s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:15 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] Lock "cinder-quobyte-a04599da-7d09-49f3-b068-483aac83ae0f" released by "delete_volume" :: held 0.986s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:15 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-01ac85ec-9bc9-4c44-9201-badd51d6f4f4 tempest-CinderUnicodeTest-478200254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450 1G" returned: 0 in 0.483s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-01ac85ec-9bc9-4c44-9201-badd51d6f4f4 tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:15 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450 Apr 07 06:16:15 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:15 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] Created reservations ['a601af87-b738-489b-b4de-46706464c0ba', '8619a961-e672-4d41-aaa9-67ae0d089b94', 'a4ad8865-868d-4454-bdc9-166d57318f00', '8910dd40-4886-4519-aacd-265149cc5f37'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:15 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:15 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:16:15 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:15 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-01ac85ec-9bc9-4c44-9201-badd51d6f4f4 tempest-CinderUnicodeTest-478200254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2 -F qcow2 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450" returned: 0 in 0.386s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:15 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-01ac85ec-9bc9-4c44-9201-badd51d6f4f4 tempest-CinderUnicodeTest-478200254 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450 is being set with open permissions: ugo+rw Apr 07 06:16:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-01ac85ec-9bc9-4c44-9201-badd51d6f4f4 tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:15 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450 Apr 07 06:16:15 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:15 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:15 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.393s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:15 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:15 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] Deleted volume successfully. Apr 07 06:16:15 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-c91f5f1c-8722-4c9c-a075-2e6a87c3f6ad tempest-VolumeDependencyTests-794886482 None] Lock "cinder-a04599da-7d09-49f3-b068-483aac83ae0f-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:16 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-01ac85ec-9bc9-4c44-9201-badd51d6f4f4 tempest-CinderUnicodeTest-478200254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450" returned: 0 in 0.397s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-01ac85ec-9bc9-4c44-9201-badd51d6f4f4 tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:16 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.info Apr 07 06:16:16 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:16 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-01ac85ec-9bc9-4c44-9201-badd51d6f4f4 tempest-CinderUnicodeTest-478200254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.info" returned: 0 in 0.412s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:16 devstack cinder-volume[82475]: WARNING cinder.volume.drivers.remotefs [None req-01ac85ec-9bc9-4c44-9201-badd51d6f4f4 tempest-CinderUnicodeTest-478200254 None] /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.info is being set with open permissions: ugo+rw Apr 07 06:16:16 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-01ac85ec-9bc9-4c44-9201-badd51d6f4f4 tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.info {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:16 devstack sudo[90700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.info Apr 07 06:16:16 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:17 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-01ac85ec-9bc9-4c44-9201-badd51d6f4f4 tempest-CinderUnicodeTest-478200254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.info" returned: 0 in 0.417s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-01ac85ec-9bc9-4c44-9201-badd51d6f4f4 tempest-CinderUnicodeTest-478200254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.730s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:17 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-01ac85ec-9bc9-4c44-9201-badd51d6f4f4 tempest-CinderUnicodeTest-478200254 None] Create snapshot completed successfully Apr 07 06:16:17 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] Acquiring lock "cinder-21b5921d-78fa-453a-a0c3-01841bb32450-delete_snapshot" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:17 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] Lock "cinder-21b5921d-78fa-453a-a0c3-01841bb32450-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:17 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] Acquiring lock "cinder-quobyte-48a3ea6a-6da2-4f1a-8af3-23d526822bd2" by "delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:17 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] Lock "cinder-quobyte-48a3ea6a-6da2-4f1a-8af3-23d526822bd2" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:17 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] Acquiring lock "cinder-quobyte-21b5921d-78fa-453a-a0c3-01841bb32450" by "_delete_snapshot" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:17 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] Lock "cinder-quobyte-21b5921d-78fa-453a-a0c3-01841bb32450" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] Deleting offline snapshot 21b5921d-78fa-453a-a0c3-01841bb32450 of volume 48a3ea6a-6da2-4f1a-8af3-23d526822bd2 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 07 06:16:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] snapshot_file for this snap is: volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450 {{(pid=82475) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 07 06:16:17 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[33eaf9bb-c22d-40ae-ab02-b32892e9cac0]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:17 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450 Apr 07 06:16:17 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:17 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450" returned: 0 in 0.430s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:17 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.remotefs [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82475) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 07 06:16:17 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e246f7a-2a2f-41ea-a9d0-3a8f072fa441]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:17 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:18 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2 Apr 07 06:16:18 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:18 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2" returned: 0 in 0.425s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:18 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450 Apr 07 06:16:18 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:18 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450" returned: 0 in 0.418s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:18 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:18 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450 Apr 07 06:16:18 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:19 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2.21b5921d-78fa-453a-a0c3-01841bb32450" returned: 0 in 0.364s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] Lock "cinder-quobyte-21b5921d-78fa-453a-a0c3-01841bb32450" released by "_delete_snapshot" :: held 1.697s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] Lock "cinder-quobyte-48a3ea6a-6da2-4f1a-8af3-23d526822bd2" released by "delete_snapshot" :: held 1.708s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:19 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] Created reservations ['541d75c6-4ae6-49af-8d1b-c00869912d5c', '3c5ba8e4-44ee-4f8e-aa1b-5d4eaec3f220', '902395a0-83e4-4d61-9f84-2f0e979fd047', '066db480-7689-479b-87cd-a7cd8a2e1c9d'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:19 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] Delete snapshot completed successfully. Apr 07 06:16:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-58d79c15-9c2a-44d3-959c-a560ca49c44a tempest-CinderUnicodeTest-478200254 None] Lock "cinder-21b5921d-78fa-453a-a0c3-01841bb32450-delete_snapshot" released by "delete_snapshot" :: held 1.782s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] Acquiring lock "cinder-48a3ea6a-6da2-4f1a-8af3-23d526822bd2-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] Lock "cinder-48a3ea6a-6da2-4f1a-8af3-23d526822bd2-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] Acquiring lock "cinder-quobyte-48a3ea6a-6da2-4f1a-8af3-23d526822bd2" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:19 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] Lock "cinder-quobyte-48a3ea6a-6da2-4f1a-8af3-23d526822bd2" acquired by "delete_volume" :: waited 0.007s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:19 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3874f47-ca6b-42c6-b282-c8da3932f6d2]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:19 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:19 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2 Apr 07 06:16:19 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:20 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2" returned: 0 in 0.423s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:20 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2 Apr 07 06:16:20 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:20 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-48a3ea6a-6da2-4f1a-8af3-23d526822bd2" returned: 0 in 0.365s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] Lock "cinder-quobyte-48a3ea6a-6da2-4f1a-8af3-23d526822bd2" released by "delete_volume" :: held 0.826s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] Created reservations ['e070a3c2-000d-4ad7-b1d4-ac02d8021d0e', '7984a54f-bba6-4a67-a9c7-3873ea91daad', '0ad2ab1a-912c-4afb-8af7-6dc817f220a8', '26778d78-be65-4260-b928-7c5b7228bc58'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:20 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:16:20 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] Acquiring lock "cinder-cb089ee1-8873-4e52-af11-55a6fd74ddac-delete_volume" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] Lock "cinder-cb089ee1-8873-4e52-af11-55a6fd74ddac-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] Acquiring lock "cinder-quobyte-cb089ee1-8873-4e52-af11-55a6fd74ddac" by "delete_volume" {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] Lock "cinder-quobyte-cb089ee1-8873-4e52-af11-55a6fd74ddac" acquired by "delete_volume" :: waited 0.010s {{(pid=82475) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4c1901-3aec-4a85-9882-c428b25add39]: (4, 'qcow2') {{(pid=83432) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cb089ee1-8873-4e52-af11-55a6fd74ddac {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:20 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cb089ee1-8873-4e52-af11-55a6fd74ddac Apr 07 06:16:20 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:20 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.406s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:20 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] Deleted volume successfully. Apr 07 06:16:20 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-3ba9b7a7-281a-43b3-b842-78151408eef7 tempest-CinderUnicodeTest-478200254 None] Lock "cinder-48a3ea6a-6da2-4f1a-8af3-23d526822bd2-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:21 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cb089ee1-8873-4e52-af11-55a6fd74ddac" returned: 0 in 0.439s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cb089ee1-8873-4e52-af11-55a6fd74ddac {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:21 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cb089ee1-8873-4e52-af11-55a6fd74ddac Apr 07 06:16:21 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:21 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134/volume-cb089ee1-8873-4e52-af11-55a6fd74ddac" returned: 0 in 0.366s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:21 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] Lock "cinder-quobyte-cb089ee1-8873-4e52-af11-55a6fd74ddac" released by "delete_volume" :: held 0.833s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:21 devstack cinder-volume[82475]: DEBUG cinder.quota [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] Created reservations ['e87020a9-2685-40df-9a81-86fb9d65e0c4', '63b8e76e-2c3c-48b7-85ac-d38fcd665e37', '487a71b0-d516-4e0e-92fa-493e51875ec9', 'b324f810-11c8-491d-8bb8-0eb79b58d1be'] {{(pid=82475) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 07 06:16:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 07 06:16:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 07 06:16:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7': None} {{(pid=82475) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 07 06:16:21 devstack cinder-volume[82475]: DEBUG cinder.volume.drivers.quobyte [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-134f67ad-3d48-484a-a738-65aa75860cc7'] {{(pid=82475) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 07 06:16:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.lockutils [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82475) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 07 06:16:21 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 07 06:16:21 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134 Apr 07 06:16:21 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 07 06:16:22 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Apr 07 06:16:22 devstack cinder-volume[82475]: DEBUG oslo_concurrency.processutils [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/366ad92e32cf683953ca97fc62542134" returned: 0 in 0.427s {{(pid=82475) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 07 06:16:22 devstack cinder-volume[82475]: DEBUG cinder.manager [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] Notifying Schedulers of capabilities ... {{(pid=82475) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 07 06:16:22 devstack cinder-volume[82475]: INFO cinder.volume.manager [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] Deleted volume successfully. Apr 07 06:16:22 devstack cinder-volume[82475]: DEBUG cinder.coordination [None req-50a989af-28b2-44c7-9c86-2a365aedc5a0 tempest-CinderUnicodeTest-478200254 None] Lock "cinder-cb089ee1-8873-4e52-af11-55a6fd74ddac-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=82475) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 07 06:16:31 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:SELECT=24,cinder:UPDATE=34,cinder:DELETE=4,cinder:INSERT=7 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 07 06:16:32 devstack cinder-volume[82475]: DEBUG dbcounter [-] [82475] Writing DB stats cinder:SELECT=22,cinder:INSERT=10,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=82475) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}